Jun 26 00:14:11 devstack cinder-volume[83501]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 26 00:14:11 devstack cinder-volume[83501]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 00:14:11 devstack cinder-volume[83501]: we strongly recommend against using it for new projects.
Jun 26 00:14:11 devstack cinder-volume[83501]: If you are already using Eventlet, we recommend migrating to a different
Jun 26 00:14:11 devstack cinder-volume[83501]: framework.  For more detail see
Jun 26 00:14:11 devstack cinder-volume[83501]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 00:14:11 devstack cinder-volume[83501]:   import eventlet  # noqa
Jun 26 00:14:14 devstack cinder-volume[83501]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:14:14 devstack cinder-volume[83501]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:14:14 devstack cinder-volume[83501]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:14:15 devstack cinder-volume[83501]: INFO dbcounter [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Registered counter for database cinder
Jun 26 00:14:15 devstack cinder-volume[83501]: DEBUG oslo_db.sqlalchemy.engines [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:14:15 devstack cinder-volume[83501]: DEBUG dbcounter [-] [83501] Writer thread running {{(pid=83501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 00:14:15 devstack cinder-volume[83501]: INFO cinder.rpc [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 26 00:14:15 devstack cinder-volume[83501]: INFO cinder.rpc [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 26 00:14:15 devstack cinder-volume[83501]: DEBUG oslo_db.sqlalchemy.engines [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:14:15 devstack cinder-volume[83501]: INFO cinder.volume.manager [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Determined volume DB was empty at startup.
Jun 26 00:14:15 devstack cinder-volume[83501]: DEBUG cinder.volume.manager [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83501) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 26 00:14:15 devstack cinder-volume[83501]: INFO cinder.volume.manager [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 26 00:14:15 devstack cinder-volume[83501]: WARNING stevedore.named [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 00:14:15 devstack cinder-volume[83501]: WARNING castellan.key_manager [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:14:15 devstack cinder-volume[83501]: WARNING cinder.keymgr.conf_key_mgr [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:14:15 devstack cinder-volume[83501]: DEBUG cinder.volume.drivers.lvm [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83501) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 26 00:14:15 devstack cinder-volume[83501]: DEBUG oslo_concurrency.processutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_concurrency.processutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.418s {{(pid=83501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_db.sqlalchemy.engines [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:14:16 devstack cinder-volume[83501]: INFO cinder.rpc [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 26 00:14:16 devstack cinder-volume[83501]: INFO cinder.rpc [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 26 00:14:16 devstack cinder-volume[83501]: WARNING stevedore.named [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 00:14:16 devstack cinder-volume[83501]: WARNING castellan.key_manager [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:14:16 devstack cinder-volume[83501]: INFO cinder.volume.manager [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_db.sqlalchemy.engines [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:14:16 devstack cinder-volume[83501]: INFO oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Starting 1 workers
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Started child 83654 {{(pid=83501) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Full set of CONF: {{(pid=83501) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] ******************************************************************************** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Configuration options gathered from: {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] ================================================================================ {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] allow_availability_zone_fallback = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] allow_compression_on_image_upload = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] allowed_direct_url_schemes     = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] api_rate_limit                 = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] auth_strategy                  = keystone {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] az_cache_duration              = 3600 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_availability_zone      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_host                   = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_name                   = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_stats_polling_interval = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backup_api_class               = cinder.backup.api.API {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backup_name_template           = backup-%s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backup_use_same_host           = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backup_use_temp_snapshot       = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] chap_password                  = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] chap_username                  =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_internal_tenant_project_id = a175e88ae9bc4147a5bd5c7eba1534ee {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_internal_tenant_user_id = 0d1dbca57dc4410298f99fe9cec34716 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cloned_volume_same_az          = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cluster                        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] compression_format             = gzip {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] config_dir                     = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] config_source                  = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] control_exchange               = openstack {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83654]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] debug                          = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] default_availability_zone      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] default_group_type             = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] default_volume_type            = lvmdriver-1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] disk_geometry                  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] driver_client_cert             = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] driver_client_cert_key         = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] driver_data_namespace          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] driver_ssl_cert_path           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] driver_ssl_cert_verify         = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] driver_use_ssl                 = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] enable_force_upload            = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] enable_new_services            = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] enable_unsupported_driver      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] enforce_multipath_for_image_xfer = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] filter_function                = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_api_insecure            = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_api_servers             = ['http://192.168.122.119/image'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_api_ssl_compression     = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_ca_certificates_file    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_certfile                = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_keyfile                 = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_num_retries             = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance_request_timeout         = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] goodness_function              = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] graceful_shutdown_timeout      = 5 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] group_api_class                = cinder.group.api.API {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] host                           = devstack {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_compress_on_upload       = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_conversion_address_space_limit = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_conversion_cpu_limit     = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_conversion_disable       = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_upload_use_cinder_backend = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_upload_use_internal_tenant = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_volume_cache_enabled     = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_volume_cache_max_count   = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] image_volume_cache_max_size_gb = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] init_host_max_objects_retrieval = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] iscsi_target_flags             =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] iscsi_write_cache              = on {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] iser_helper                    = tgtadm {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] iser_ip_address                = 192.168.122.119 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] iser_port                      = 3260 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_color                      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_config_append              = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_dir                        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_file                       = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_options                    = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_rotate_interval            = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_rotate_interval_type       = days {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] log_rotation_type              = none {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] max_age                        = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] max_logfile_count              = 30 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] max_logfile_size_mb            = 200 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] max_over_subscription_ratio    = 20.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] message_reap_interval          = 86400 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] message_ttl                    = 2592000 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] migration_create_volume_timeout_secs = 300 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] monkey_patch                   = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] monkey_patch_modules           = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] my_ip                          = 192.168.122.119 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] no_snapshot_gb_quota           = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] num_iser_scan_tries            = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] num_shell_tries                = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] num_volume_device_scan_tries   = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] nvmeof_conn_info_version       = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] nvmet_ns_id                    = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] nvmet_port_id                  = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_max_limit                = 1000 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_volume_ext_list          = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_volume_listen_port       = 8776 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_volume_use_ssl           = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] osapi_volume_workers           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] per_volume_size_limit          = -1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] periodic_fuzzy_delay           = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] periodic_interval              = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] public_endpoint                = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] publish_errors                 = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_backup_gigabytes         = 1000 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_backups                  = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_gigabytes                = 1000 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_groups                   = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_snapshots                = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] quota_volumes                  = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] rate_limit_burst               = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] rate_limit_except_level        = CRITICAL {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] rate_limit_interval            = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] reinit_driver_count            = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] replication_device             = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] report_discard_supported       = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] report_interval                = 120 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] reservation_clean_interval     = 86400 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] reservation_expire             = 86400 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] reserved_image_namespaces      = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] reserved_percentage            = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] rpc_response_timeout           = 120 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] run_external_periodic_tasks    = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] scst_target_driver             = iscsi {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] scst_target_iqn_name           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_down_time              = 720 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] shell_completion               = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] snapshot_name_template         = snapshot-%s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] snapshot_same_host             = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] split_loggers                  = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] state_path                     = /opt/stack/data/cinder {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] storage_availability_zone      = nova {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] storage_protocol               = iSCSI {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] syslog_log_facility            = LOG_USER {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] target_helper                  = lioadm {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] target_ip_address              = 192.168.122.119 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] target_port                    = 3260 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] target_protocol                = iscsi {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] target_secondary_ip_addresses  = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] trace_flags                    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] transport_url                  = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] until_refresh                  = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_chap_auth                  = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_default_quota_class        = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_journal                    = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_json                       = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_multipath_for_image_xfer   = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_stderr                     = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] use_syslog                     = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] verify_glance_signatures       = enabled {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_api_class               = cinder.volume.api.API {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_backend_name            = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_clear                   = zero {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_clear_ionice            = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_clear_size              = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_copy_bps_limit          = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_dd_blocksize            = 1M {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_name_template           = volume-%s {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_service_inithost_offload = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volume_usage_audit_period      = month {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] zoning_mode                    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_concurrency.disable_process_locking = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.auth_section = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.auth_type   = password {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.auth_version = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.cache       = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.certfile    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.include_service_catalog = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.insecure    = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.interface   = public {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.keyfile     = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_password =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcache_username =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.region_name = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.service_type = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.backend                  = dogpile.cache.null {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.backend_argument         = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.backend_expiration_time  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.config_prefix            = cache.oslo {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.debug_cache_backend      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.enable_retry_client      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.enable_socket_keepalive  = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.enabled                  = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.expiration_time          = 600 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.hashclient_retry_attempts = 2 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_dead_retry      = 300 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_sasl_enabled    = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.password                 = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.proxies                  = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.redis_db                 = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.redis_server             = localhost:6379 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.retry_attempts           = 2 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.retry_delay              = 0.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.socket_keepalive_count   = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.socket_keepalive_idle    = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.socket_keepalive_interval = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.socket_timeout           = 1.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.tls_allowed_ciphers      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.tls_cafile               = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.tls_certfile             = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.tls_enabled              = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.tls_keyfile              = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cache.username                 = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] coordination.backend_url       = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.asyncio_connection    = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.asyncio_slave_connection = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.backend               = sqlalchemy {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.connection            = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.connection_debug      = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.connection_parameters =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.connection_recycle_time = 3600 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.connection_trace      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.db_inc_retry_interval = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.db_max_retries        = 20 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.db_max_retry_interval = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.db_retry_interval     = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.max_overflow          = 50 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.max_pool_size         = 5 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.max_retries           = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.mysql_wsrep_sync_wait = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.pool_timeout          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.retry_interval        = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.slave_connection      = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.sqlite_synchronous    = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.synchronous_reader    = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] database.use_db_reconnect      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.connection_string     = messaging:// {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.enabled               = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: INFO cinder.volume.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.es_doc_type           = notification {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.es_scroll_size        = 10000 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.es_scroll_time        = 2m {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.filter_error_trace    = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.hmac_keys             = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.sentinel_service_name = mymaster {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.socket_timeout        = 0.1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.trace_requests        = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler.trace_sqlalchemy      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler_jaeger.process_tags   = {} {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler_jaeger.service_name_prefix = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] profiler_otlp.service_name_prefix = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.enforce_new_defaults = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: WARNING oslo_config.cfg [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.enforce_scope      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.policy_default_rule = default {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.group          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.helper_command = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] privsep_osbrick.user           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.group         = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.helper_command = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] cinder_sys_admin.user          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.auth_section      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.auth_type         = password {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.cafile            = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.certfile          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.collect_timing    = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.insecure          = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.keyfile           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.send_service_user_token = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.split_loggers     = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] service_user.timeout           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.auth_section            = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.auth_type               = password {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.certfile                = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.collect_timing          = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.insecure                = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.keyfile                 = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.region_name             = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.split_loggers           = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] glance.timeout                 = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.backend_availability_zone = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.chap_password = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.chap_username =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.disk_geometry = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.driver_client_cert = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.driver_client_cert_key = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.driver_data_namespace = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.driver_use_ssl = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.extra_capabilities = {} {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.filter_function = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.goodness_function = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.iscsi_target_flags =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.iscsi_write_cache = on {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.iser_port     = 3260 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.lvm_share_target = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.lvm_type      = auto {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.num_shell_tries = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.replication_device = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.report_discard_supported = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.reserved_percentage = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.target_helper = tgtadm {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.target_port   = 3260 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.target_protocol = iscsi {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.trace_flags   = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.unique_fqdn_network = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.use_chap_auth = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_backend_name = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_clear  = zero {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_clear_ionice = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_clear_size = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_reports.file_event_handler = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_reports.log_dir           = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.backend_host       = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.chap_password      = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.chap_username      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.disk_geometry      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.driver_client_cert = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.extra_capabilities = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.filter_function    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.goodness_function  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.iser_helper        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.iser_ip_address    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.iser_port          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.lvm_share_target   = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.lvm_type           = auto {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.num_shell_tries    = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.replication_device = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.report_discard_supported = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.reserved_percentage = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.scst_target_driver = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.storage_protocol   = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.target_helper      = lioadm {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.target_ip_address  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.target_port        = 3260 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.trace_flags        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.use_chap_auth      = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_clear       = zero {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_clear_size  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] lvmdriver-1.volumes_dir        = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_notifications.driver = [] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_notifications.retry = -1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] key_manager.fixed_key          = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.barbican_api_version  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.barbican_endpoint     = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.barbican_endpoint_type = public {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.barbican_region_name  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.cafile                = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.certfile              = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.collect_timing        = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.insecure              = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.keyfile               = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.number_of_retries     = 60 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.retry_delay           = 1 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.send_service_user_token = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.split_loggers         = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.timeout               = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.verify_ssl            = True {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican.verify_ssl_path       = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.auth_section = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.auth_type = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.cafile   = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.certfile = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.collect_timing = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.insecure = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.keyfile  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.split_loggers = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] barbican_service_user.timeout  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.approle_role_id          = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.approle_secret_id        = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.kv_mountpoint            = secret {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.kv_path                  = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.kv_version               = 2 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.namespace                = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.root_token_id            = **** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.ssl_ca_crt_file          = None {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.timeout                  = 60.0 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.use_ssl                  = False {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:14:16 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] ******************************************************************************** {{(pid=83501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 26 00:14:16 devstack sudo[83660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 26 00:14:16 devstack sudo[83660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:17 devstack sudo[83660]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:17 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:17 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:17 devstack sudo[83808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:17 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:18 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.627s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:14:18 devstack cinder-volume[83654]: INFO cinder.brick.local_dev.lvm [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:18 devstack sudo[83997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:14:18 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:18 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG cinder.brick.local_dev.lvm [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83654) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 26 00:14:18 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:18 devstack sudo[84226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:18 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:20 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.178s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:20 devstack sudo[84434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:20 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:20 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.699s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:20 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:20 devstack sudo[84439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 26 00:14:20 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:21 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:21 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.753s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:21 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:21 devstack sudo[84444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:14:21 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:22 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:22 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.888s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:22 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:22 devstack sudo[84456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:14:22 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:23 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:23 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.835s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:23 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:23 devstack sudo[84461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:23 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:24 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:24 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.780s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:24 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:24 devstack sudo[84470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:24 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:24 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:24 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:24 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:24 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:24 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:24 devstack sudo[84475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:24 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:25 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:25 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:25 devstack cinder-volume[83654]: INFO cinder.volume.drivers.lvm [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 26 00:14:25 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:25 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:25 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:25 devstack sudo[84485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:25 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:26 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:26 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:26 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:14:26 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:26 devstack sudo[84601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:14:26 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:26 devstack cinder-volume[83501]: DEBUG dbcounter [-] [83501] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:14:26 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:26 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:26 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:26 devstack sudo[84742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:26 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:27 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:27 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:27 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:27 devstack sudo[84746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:27 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:28 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:28 devstack sudo[84749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:28 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:28 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:28 devstack cinder-volume[83654]: INFO cinder.volume.driver [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Driver hasn't implemented _init_vendor_properties()
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG cinder.volume.driver [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83654) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG oslo_db.sqlalchemy.engines [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writer thread running {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG cinder.db.api [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Building query based on filter {{(pid=83654) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG cinder.image.image_utils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83654) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 26 00:14:28 devstack cinder-volume[83654]: INFO cinder.keymgr.migration [None req-37af403d-8f60-49ac-862c-d0db89bc16f7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:14:28 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:28 devstack sudo[84753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:14:28 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:29 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:29 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:29 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:29 devstack sudo[84760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:29 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:30 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:30 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:30 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:30 devstack sudo[84763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:30 devstack sudo[84763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:30 devstack sudo[84763]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:30 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:30 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:30 devstack sudo[84767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:30 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:31 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:31 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:31 devstack cinder-volume[83654]: DEBUG cinder.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Notifying Schedulers of capabilities ... {{(pid=83654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:14:31 devstack cinder-volume[83654]: INFO cinder.volume.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Driver initialization completed successfully.
Jun 26 00:14:31 devstack cinder-volume[83654]: INFO cinder.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Initiating service 2 cleanup
Jun 26 00:14:31 devstack cinder-volume[83654]: INFO cinder.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Service 2 cleanup completed.
Jun 26 00:14:31 devstack cinder-volume[83654]: DEBUG cinder.service [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Creating RPC server for service cinder-volume {{(pid=83654) start /opt/stack/cinder/cinder/service.py:231}}
Jun 26 00:14:31 devstack cinder-volume[83654]: DEBUG cinder.service [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83654) start /opt/stack/cinder/cinder/service.py:237}}
Jun 26 00:14:31 devstack cinder-volume[83654]: INFO cinder.volume.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 26 00:14:31 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:14:31 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:31 devstack sudo[84771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:14:31 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:32 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:32 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:32 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:32 devstack sudo[84774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:32 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:33 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:33 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:33 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:33 devstack sudo[84809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:14:33 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:33 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:33 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:33 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:14:33 devstack sudo[84838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:14:33 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:14:34 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root
Jun 26 00:14:34 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:14:34 devstack cinder-volume[83654]: INFO cinder.volume.manager [None req-a74de09d-6140-4018-8651-fb1e75dc3e09 None None] Driver post RPC initialization completed successfully.
Jun 26 00:14:44 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writing DB stats cinder:SELECT=3 {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:14:44 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:14:52 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager._thread_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:14:52 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread count: 6 {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:14:52 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread info: [<_MainThread(MainThread, started 136699364331648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136699252667392)>, <Thread(Thread-3 (stat_writer), started daemon 136699255146112)>, <Thread(Rabbit-heartbeat, started daemon 136699263100864)>, <Thread(Thread-5 (_runner), started daemon 136699252279168)>, <Thread(Thread-7 (_runner), started daemon 136699252398912)>] {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:15:52 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:15:52 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:15:52 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:15:52 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:15:52 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:15:53 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Jun 26 00:15:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:15:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:15:53 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:15:53 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:15:53 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Jun 26 00:15:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:15:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:15:53 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:15:53 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:15:54 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Jun 26 00:15:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:15:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:15:54 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:15:54 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:15:55 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Jun 26 00:15:55 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:15:55 devstack cinder-volume[83654]: DEBUG cinder.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Notifying Schedulers of capabilities ... {{(pid=83654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:15:55 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager._thread_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:15:55 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread count: 6 {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:15:55 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread info: [<_MainThread(MainThread, started 136699364331648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136699252667392)>, <Thread(Thread-3 (stat_writer), started daemon 136699255146112)>, <Thread(Rabbit-heartbeat, started daemon 136699263100864)>, <Thread(Thread-5 (_runner), started daemon 136699252279168)>, <Thread(Thread-7 (_runner), started daemon 136699252398912)>] {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:16:44 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writing DB stats cinder:SELECT=1 {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:16:44 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writing DB stats cinder:UPDATE=1 {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:16:52 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:16:52 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:16:52 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:16:52 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:16:52 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:16:53 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Jun 26 00:16:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:16:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:16:53 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:16:53 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:16:53 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Jun 26 00:16:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:16:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:16:53 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:16:53 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:16:54 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.605s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:16:54 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:16:54 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:16:54 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG cinder.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Notifying Schedulers of capabilities ... {{(pid=83654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager._thread_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread count: 6 {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:16:54 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread info: [<_MainThread(MainThread, started 136699364331648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136699252667392)>, <Thread(Thread-3 (stat_writer), started daemon 136699255146112)>, <Thread(Rabbit-heartbeat, started daemon 136699263100864)>, <Thread(Thread-5 (_runner), started daemon 136699252279168)>, <Thread(Thread-7 (_runner), started daemon 136699252398912)>] {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:17:52 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:17:52 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:17:52 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:17:52 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:17:52 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:17:53 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Jun 26 00:17:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:17:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:17:53 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:17:53 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:17:53 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Jun 26 00:17:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:17:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:17:53 devstack sudo[91853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:17:53 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:17:54 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root
Jun 26 00:17:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:17:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:17:54 devstack sudo[91876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:17:54 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:17:54 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root
Jun 26 00:17:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:17:54 devstack cinder-volume[83654]: DEBUG cinder.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Notifying Schedulers of capabilities ... {{(pid=83654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:18:44 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writing DB stats cinder:SELECT=1 {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:18:44 devstack cinder-volume[83654]: DEBUG dbcounter [-] [83654] Writing DB stats cinder:UPDATE=1 {{(pid=83654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:18:52 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:18:52 devstack cinder-volume[83654]: DEBUG cinder.volume.drivers.lvm [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Updating volume stats {{(pid=83654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 00:18:52 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:18:52 devstack sudo[92996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 00:18:52 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:18:53 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root
Jun 26 00:18:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:18:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:18:53 devstack sudo[93004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:18:53 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:18:53 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root
Jun 26 00:18:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:18:53 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:18:53 devstack sudo[93008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 00:18:53 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:18:54 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:18:54 devstack sudo[93022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 00:18:54 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:18:54 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG oslo_concurrency.processutils [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=83654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG cinder.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Notifying Schedulers of capabilities ... {{(pid=83654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG oslo_service.periodic_task [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] Running periodic task VolumeManager._thread_info {{(pid=83654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread count: 6 {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:18:54 devstack cinder-volume[83654]: DEBUG cinder.volume.manager [None req-188165a1-ea78-4ee6-81a2-851290916463 None None] thread info: [<_MainThread(MainThread, started 136699364331648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136699252667392)>, <Thread(Thread-3 (stat_writer), started daemon 136699255146112)>, <Thread(Rabbit-heartbeat, started daemon 136699263100864)>, <Thread(Thread-5 (_runner), started daemon 136699252279168)>, <Thread(Thread-7 (_runner), started daemon 136699252398912)>] {{(pid=83654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:19:17 devstack cinder-volume[83501]: INFO oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Caught SIGTERM, stopping children
Jun 26 00:19:17 devstack cinder-volume[83501]: DEBUG oslo_concurrency.lockutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Acquiring lock "singleton_lock" {{(pid=83501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:19:17 devstack cinder-volume[83501]: DEBUG oslo_concurrency.lockutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Acquired lock "singleton_lock" {{(pid=83501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:19:17 devstack cinder-volume[83501]: DEBUG oslo_concurrency.lockutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Releasing lock "singleton_lock" {{(pid=83501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:19:17 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Stop services. {{(pid=83501) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 26 00:19:17 devstack cinder-volume[83501]: DEBUG oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Killing children. {{(pid=83501) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 26 00:19:17 devstack cinder-volume[83501]: INFO oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Waiting on 1 children to exit
Jun 26 00:19:21 devstack cinder-volume[83654]: DEBUG oslo_concurrency.lockutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Acquiring lock "singleton_lock" {{(pid=83654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:19:21 devstack cinder-volume[83654]: DEBUG oslo_concurrency.lockutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Acquired lock "singleton_lock" {{(pid=83654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:19:21 devstack cinder-volume[83654]: DEBUG oslo_concurrency.lockutils [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Releasing lock "singleton_lock" {{(pid=83654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:19:21 devstack cinder-volume[83654]: WARNING amqp [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 00:19:21 devstack cinder-volume[83654]: WARNING amqp [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 00:19:21 devstack cinder-volume[83501]: INFO oslo_service.backend._eventlet.service [None req-5a721c15-f7b2-4327-9a0c-398ff2618ca1 None None] Child 83654 exited with status 0
Jun 26 00:19:22 devstack cinder-volume[93751]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 26 00:19:22 devstack cinder-volume[93751]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 00:19:22 devstack cinder-volume[93751]: we strongly recommend against using it for new projects.
Jun 26 00:19:22 devstack cinder-volume[93751]: If you are already using Eventlet, we recommend migrating to a different
Jun 26 00:19:22 devstack cinder-volume[93751]: framework.  For more detail see
Jun 26 00:19:22 devstack cinder-volume[93751]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 00:19:22 devstack cinder-volume[93751]:   import eventlet  # noqa
Jun 26 00:19:24 devstack cinder-volume[93751]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:19:24 devstack cinder-volume[93751]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:19:24 devstack cinder-volume[93751]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:19:24 devstack cinder-volume[93751]: INFO dbcounter [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Registered counter for database cinder
Jun 26 00:19:24 devstack cinder-volume[93751]: DEBUG oslo_db.sqlalchemy.engines [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG dbcounter [-] [93751] Writer thread running {{(pid=93751) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 00:19:25 devstack cinder-volume[93751]: INFO cinder.rpc [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 26 00:19:25 devstack cinder-volume[93751]: INFO cinder.rpc [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_db.sqlalchemy.engines [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:25 devstack cinder-volume[93751]: INFO cinder.volume.manager [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Determined volume DB was empty at startup.
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG cinder.volume.manager [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93751) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 26 00:19:25 devstack cinder-volume[93751]: INFO cinder.volume.manager [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 26 00:19:25 devstack cinder-volume[93751]: WARNING stevedore.named [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 00:19:25 devstack cinder-volume[93751]: WARNING castellan.key_manager [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:19:25 devstack cinder-volume[93751]: WARNING cinder.keymgr.conf_key_mgr [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:19:25 devstack cinder-volume[93751]: INFO cinder.volume.manager [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_db.sqlalchemy.engines [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:25 devstack cinder-volume[93751]: INFO oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Starting 1 workers
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Started child 93967 {{(pid=93751) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Full set of CONF: {{(pid=93751) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] ******************************************************************************** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 26 00:19:25 devstack cinder-volume[93967]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Configuration options gathered from: {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] ================================================================================ {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] allow_availability_zone_fallback = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] allow_compression_on_image_upload = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] allowed_direct_url_schemes     = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] api_rate_limit                 = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] auth_strategy                  = keystone {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_availability_zone      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_host                   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_name                   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_stats_polling_interval = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backup_api_class               = cinder.backup.api.API {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backup_name_template           = backup-%s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backup_use_same_host           = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backup_use_temp_snapshot       = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] chap_password                  = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] chap_username                  =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_internal_tenant_project_id = a175e88ae9bc4147a5bd5c7eba1534ee {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_internal_tenant_user_id = 0d1dbca57dc4410298f99fe9cec34716 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cluster                        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] compression_format             = gzip {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] config_dir                     = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] config_source                  = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] control_exchange               = openstack {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] debug                          = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] default_availability_zone      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] default_group_type             = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] default_volume_type            = QuobyteHD {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] disk_geometry                  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] driver_client_cert             = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] driver_client_cert_key         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] driver_data_namespace          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] driver_ssl_cert_path           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] driver_ssl_cert_verify         = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] driver_use_ssl                 = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] enable_new_services            = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] enable_unsupported_driver      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] enabled_backends               = ['QuobyteHD'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] enforce_multipath_for_image_xfer = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] filter_function                = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_api_insecure            = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_api_servers             = ['http://192.168.122.119/image'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_api_ssl_compression     = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_ca_certificates_file    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_certfile                = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_keyfile                 = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_num_retries             = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance_request_timeout         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] goodness_function              = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] graceful_shutdown_timeout      = 5 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] group_api_class                = cinder.group.api.API {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] host                           = devstack {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_compress_on_upload       = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_conversion_address_space_limit = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_conversion_cpu_limit     = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_conversion_disable       = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_upload_use_cinder_backend = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_upload_use_internal_tenant = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_volume_cache_enabled     = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_volume_cache_max_count   = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] image_volume_cache_max_size_gb = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] init_host_max_objects_retrieval = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] iscsi_target_flags             =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] iscsi_write_cache              = on {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] iser_helper                    = tgtadm {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] iser_ip_address                = 192.168.122.119 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] iser_port                      = 3260 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_color                      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_config_append              = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_dir                        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_file                       = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_options                    = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_rotate_interval            = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_rotate_interval_type       = days {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] log_rotation_type              = none {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93967]: INFO cinder.volume.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.remotefs [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93967) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] max_age                        = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] max_logfile_count              = 30 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] max_logfile_size_mb            = 200 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] max_over_subscription_ratio    = 20.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] message_reap_interval          = 86400 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] message_ttl                    = 2592000 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] migration_create_volume_timeout_secs = 300 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] monkey_patch                   = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] monkey_patch_modules           = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] my_ip                          = 192.168.122.119 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] no_snapshot_gb_quota           = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] num_iser_scan_tries            = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] num_shell_tries                = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] num_volume_device_scan_tries   = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] nvmeof_conn_info_version       = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] nvmet_ns_id                    = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] nvmet_port_id                  = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_max_limit                = 1000 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_volume_ext_list          = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_volume_listen_port       = 8776 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_volume_use_ssl           = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] osapi_volume_workers           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] per_volume_size_limit          = -1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] periodic_fuzzy_delay           = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] periodic_interval              = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] public_endpoint                = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] publish_errors                 = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_backup_gigabytes         = 1000 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_backups                  = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_gigabytes                = 1000 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_groups                   = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_snapshots                = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] quota_volumes                  = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] rate_limit_burst               = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] rate_limit_except_level        = CRITICAL {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] rate_limit_interval            = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] reinit_driver_count            = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] replication_device             = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] report_discard_supported       = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] report_interval                = 120 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] reservation_clean_interval     = 86400 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] reservation_expire             = 86400 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] reserved_image_namespaces      = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] reserved_percentage            = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] rpc_response_timeout           = 120 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] run_external_periodic_tasks    = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] scst_target_driver             = iscsi {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] scst_target_iqn_name           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_down_time              = 720 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] shell_completion               = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] snapshot_name_template         = snapshot-%s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] split_loggers                  = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] state_path                     = /opt/stack/data/cinder {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] storage_availability_zone      = nova {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] storage_protocol               = iSCSI {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] syslog_log_facility            = LOG_USER {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] target_helper                  = lioadm {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] target_ip_address              = 192.168.122.119 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] target_port                    = 3260 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] target_protocol                = iscsi {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] target_secondary_ip_addresses  = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] trace_flags                    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] transport_url                  = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] until_refresh                  = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_chap_auth                  = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_default_quota_class        = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_journal                    = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_json                       = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_multipath_for_image_xfer   = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_stderr                     = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] use_syslog                     = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] verify_glance_signatures       = enabled {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_api_class               = cinder.volume.api.API {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_backend_name            = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_clear                   = zero {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_clear_ionice            = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_clear_size              = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_copy_bps_limit          = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_dd_blocksize            = 1M {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_name_template           = volume-%s {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_service_inithost_offload = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volume_usage_audit_period      = month {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] zoning_mode                    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_concurrency.disable_process_locking = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.auth_section = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.auth_type   = password {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.auth_version = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.cache       = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.certfile    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.include_service_catalog = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.insecure    = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.interface   = public {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.keyfile     = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_password =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcache_username =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93967) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 26 00:19:25 devstack cinder-volume[93967]: WARNING cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 26 00:19:25 devstack cinder-volume[93967]: WARNING cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Running cmd (subprocess): mount.quobyte {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.region_name = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.service_type = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.backend                  = dogpile.cache.null {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.backend_argument         = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.backend_expiration_time  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.config_prefix            = cache.oslo {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.debug_cache_backend      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.enable_retry_client      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.enable_socket_keepalive  = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.enabled                  = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.expiration_time          = 600 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.hashclient_retry_attempts = 2 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_dead_retry      = 300 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_sasl_enabled    = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.password                 = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.proxies                  = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.redis_db                 = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.redis_server             = localhost:6379 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.retry_attempts           = 2 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.retry_delay              = 0.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.socket_keepalive_count   = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.socket_keepalive_idle    = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.socket_keepalive_interval = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.socket_timeout           = 1.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.tls_allowed_ciphers      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.tls_cafile               = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.tls_certfile             = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.tls_enabled              = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.tls_keyfile              = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cache.username                 = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] coordination.backend_url       = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.asyncio_connection    = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.asyncio_slave_connection = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.backend               = sqlalchemy {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.connection            = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.connection_debug      = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.connection_parameters =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.connection_recycle_time = 3600 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.connection_trace      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.db_inc_retry_interval = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.db_max_retries        = 20 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.db_max_retry_interval = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.db_retry_interval     = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.max_overflow          = 50 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.max_pool_size         = 5 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.max_retries           = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.mysql_wsrep_sync_wait = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.pool_timeout          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.retry_interval        = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.slave_connection      = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.sqlite_synchronous    = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.synchronous_reader    = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] database.use_db_reconnect      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.connection_string     = messaging:// {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.enabled               = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.es_doc_type           = notification {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.es_scroll_size        = 10000 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.es_scroll_time        = 2m {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.filter_error_trace    = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.hmac_keys             = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.sentinel_service_name = mymaster {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.socket_timeout        = 0.1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.trace_requests        = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler.trace_sqlalchemy      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler_jaeger.process_tags   = {} {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler_jaeger.service_name_prefix = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] profiler_otlp.service_name_prefix = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.enforce_new_defaults = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: WARNING oslo_config.cfg [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.enforce_scope      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.policy_default_rule = default {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.group          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.helper_command = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] privsep_osbrick.user           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.group         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.helper_command = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] cinder_sys_admin.user          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.auth_section      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.auth_type         = password {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.cafile            = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.certfile          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.collect_timing    = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.insecure          = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.keyfile           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.send_service_user_token = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.split_loggers     = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] service_user.timeout           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.auth_section            = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.auth_type               = password {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.certfile                = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.collect_timing          = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.insecure                = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.keyfile                 = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.region_name             = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.split_loggers           = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] glance.timeout                 = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.backend_availability_zone = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.chap_password = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.chap_username =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.disk_geometry = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.driver_client_cert = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.driver_client_cert_key = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.driver_data_namespace = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.driver_use_ssl = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.extra_capabilities = {} {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.filter_function = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.goodness_function = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.iscsi_target_flags =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.iscsi_write_cache = on {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.iser_port     = 3260 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_host      =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_login     = admin {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_mount_options = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_password  = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_private_key =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_share_path =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.num_shell_tries = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.quobyte_volume_url = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.replication_device = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.report_discard_supported = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.reserved_percentage = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.target_helper = tgtadm {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.target_port   = 3260 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.target_protocol = iscsi {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.trace_flags   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.unique_fqdn_network = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.use_chap_auth = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_backend_name = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_clear  = zero {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_clear_ionice = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_clear_size = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_reports.file_event_handler = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_reports.log_dir           = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.backend_availability_zone = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.backend_host         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.chap_password        = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.chap_username        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.chiscsi_conf         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.disk_geometry        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.driver_client_cert   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.driver_data_namespace = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.driver_use_ssl       = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.extra_capabilities   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.filter_function      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.goodness_function    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.iser_helper          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.iser_ip_address      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.iser_port            = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.iser_target_prefix   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_host             = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_login            = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_mount_options    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_password         = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_private_key      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_share_path       = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_ssh_port         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.num_shell_tries      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.nvmet_port_id        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.replication_device   = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.report_discard_supported = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.reserved_percentage  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.scst_target_driver   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.storage_protocol     = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.target_helper        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.target_ip_address    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.target_port          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.target_prefix        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.target_protocol      = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.trace_flags          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.use_chap_auth        = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_clear         = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_clear_size    = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=93967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] QuobyteHD.volumes_dir          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: INFO cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 ...
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca -c /etc/quobyte/client-cinder.cfg {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_notifications.driver = [] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_notifications.retry = -1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] key_manager.fixed_key          = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.barbican_api_version  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.barbican_endpoint     = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.barbican_endpoint_type = public {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.barbican_region_name  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.cafile                = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.certfile              = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.collect_timing        = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.insecure              = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.keyfile               = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.number_of_retries     = 60 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.retry_delay           = 1 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.send_service_user_token = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.split_loggers         = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.timeout               = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.verify_ssl            = True {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican.verify_ssl_path       = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.auth_section = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.auth_type = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.cafile   = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.certfile = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.collect_timing = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.insecure = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.keyfile  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.split_loggers = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] barbican_service_user.timeout  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.approle_role_id          = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.approle_secret_id        = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.kv_mountpoint            = secret {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.kv_path                  = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.kv_version               = 2 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.namespace                = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.root_token_id            = **** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.ssl_ca_crt_file          = None {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.timeout                  = 60.0 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.use_ssl                  = False {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:25 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] ******************************************************************************** {{(pid=93751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 26 00:19:25 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca -c /etc/quobyte/client-cinder.cfg
Jun 26 00:19:25 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:26 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:26 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.774s {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:26 devstack cinder-volume[93967]: INFO cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 succeeded
Jun 26 00:19:26 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=93967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:26 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.791s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:26 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:26 devstack sudo[94043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:26 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:27 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.674s {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:27 devstack cinder-volume[93967]: INFO cinder.volume.driver [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Driver hasn't implemented _init_vendor_properties()
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG cinder.volume.driver [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93967) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG oslo_db.sqlalchemy.engines [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93967) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG dbcounter [-] [93967] Writer thread running {{(pid=93967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG cinder.db.api [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Building query based on filter {{(pid=93967) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG cinder.image.image_utils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93967) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 26 00:19:27 devstack cinder-volume[93967]: INFO cinder.keymgr.migration [None req-7bde5fd5-cc76-4eaa-a5bd-6c6810084449 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=93967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=93967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:27 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:27 devstack sudo[94046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:27 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:28 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.632s {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG cinder.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Notifying Schedulers of capabilities ... {{(pid=93967) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:19:28 devstack cinder-volume[93967]: INFO cinder.volume.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Driver initialization completed successfully.
Jun 26 00:19:28 devstack cinder-volume[93967]: INFO cinder.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Initiating service 3 cleanup
Jun 26 00:19:28 devstack cinder-volume[93967]: INFO cinder.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Service 3 cleanup completed.
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG cinder.service [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Creating RPC server for service cinder-volume {{(pid=93967) start /opt/stack/cinder/cinder/service.py:231}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG cinder.service [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93967) start /opt/stack/cinder/cinder/service.py:237}}
Jun 26 00:19:28 devstack cinder-volume[93967]: INFO cinder.volume.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=93967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=93967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:28 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:28 devstack sudo[94053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:28 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:29 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:29 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.776s {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:29 devstack cinder-volume[93967]: INFO cinder.volume.manager [None req-249cf164-4ef2-4a0b-9f12-c265f326a89b None None] Driver post RPC initialization completed successfully.
Jun 26 00:19:32 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:32 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:32 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=93967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:33 devstack cinder-volume[93967]: DEBUG cinder.volume.drivers.quobyte [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=93967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:33 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:33 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:33 devstack sudo[94168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:33 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:33 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:33 devstack cinder-volume[93967]: DEBUG oslo_concurrency.processutils [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.620s {{(pid=93967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:33 devstack cinder-volume[93967]: DEBUG cinder.manager [None req-8018f956-43c9-4600-9ad1-d251f134959f None None] Notifying Schedulers of capabilities ... {{(pid=93967) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:19:35 devstack cinder-volume[93751]: INFO oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Caught SIGTERM, stopping children
Jun 26 00:19:35 devstack cinder-volume[93751]: DEBUG oslo_concurrency.lockutils [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Acquiring lock "singleton_lock" {{(pid=93751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:19:35 devstack cinder-volume[93751]: DEBUG oslo_concurrency.lockutils [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Acquired lock "singleton_lock" {{(pid=93751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:19:35 devstack cinder-volume[93751]: DEBUG oslo_concurrency.lockutils [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Releasing lock "singleton_lock" {{(pid=93751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:19:35 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Stop services. {{(pid=93751) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 26 00:19:35 devstack cinder-volume[93751]: DEBUG oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Killing children. {{(pid=93751) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 26 00:19:35 devstack cinder-volume[93751]: INFO oslo_service.backend._eventlet.service [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Waiting on 1 children to exit
Jun 26 00:19:39 devstack cinder-volume[93967]: DEBUG dbcounter [-] [93967] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:19:39 devstack cinder-volume[93967]: DEBUG dbcounter [-] [93967] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:19:40 devstack cinder-volume[93967]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 26 00:19:40 devstack cinder-volume[94259]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 26 00:19:40 devstack cinder-volume[94259]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 00:19:40 devstack cinder-volume[94259]: we strongly recommend against using it for new projects.
Jun 26 00:19:40 devstack cinder-volume[94259]: If you are already using Eventlet, we recommend migrating to a different
Jun 26 00:19:40 devstack cinder-volume[94259]: framework.  For more detail see
Jun 26 00:19:40 devstack cinder-volume[94259]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 00:19:40 devstack cinder-volume[94259]:   import eventlet  # noqa
Jun 26 00:19:41 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Acquiring lock "singleton_lock" {{(pid=93967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:19:41 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Acquired lock "singleton_lock" {{(pid=93967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:19:41 devstack cinder-volume[93967]: DEBUG oslo_concurrency.lockutils [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Releasing lock "singleton_lock" {{(pid=93967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:19:41 devstack cinder-volume[93967]: WARNING amqp [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 00:19:41 devstack cinder-volume[93967]: WARNING amqp [None req-5161ff8f-fcd9-4c3a-b8db-9cd0709aa7d5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 00:19:43 devstack cinder-volume[94259]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 00:19:43 devstack cinder-volume[94259]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 00:19:43 devstack cinder-volume[94259]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 00:19:43 devstack cinder-volume[94259]: INFO dbcounter [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Registered counter for database cinder
Jun 26 00:19:43 devstack cinder-volume[94259]: DEBUG oslo_db.sqlalchemy.engines [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG dbcounter [-] [94259] Writer thread running {{(pid=94259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 00:19:44 devstack cinder-volume[94259]: INFO cinder.rpc [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 26 00:19:44 devstack cinder-volume[94259]: INFO cinder.rpc [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_db.sqlalchemy.engines [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:44 devstack cinder-volume[94259]: INFO cinder.volume.manager [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Determined volume DB was empty at startup.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG cinder.volume.manager [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94259) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 26 00:19:44 devstack cinder-volume[94259]: WARNING stevedore.named [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 00:19:44 devstack cinder-volume[94259]: WARNING castellan.key_manager [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:19:44 devstack cinder-volume[94259]: WARNING cinder.keymgr.conf_key_mgr [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 00:19:44 devstack cinder-volume[94259]: INFO cinder.volume.manager [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_db.sqlalchemy.engines [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:44 devstack cinder-volume[94259]: INFO oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Starting 1 workers
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Started child 94563 {{(pid=94259) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Full set of CONF: {{(pid=94259) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] ******************************************************************************** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 26 00:19:44 devstack cinder-volume[94563]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Configuration options gathered from: {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] ================================================================================ {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] allow_availability_zone_fallback = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] allow_compression_on_image_upload = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] allowed_direct_url_schemes     = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] api_rate_limit                 = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] auth_strategy                  = keystone {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_availability_zone      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_host                   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_name                   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_stats_polling_interval = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backup_api_class               = cinder.backup.api.API {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backup_name_template           = backup-%s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backup_use_same_host           = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backup_use_temp_snapshot       = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] chap_password                  = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] chap_username                  =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_internal_tenant_project_id = a175e88ae9bc4147a5bd5c7eba1534ee {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_internal_tenant_user_id = 0d1dbca57dc4410298f99fe9cec34716 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cluster                        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] compression_format             = gzip {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] compute_api_class              = cinder.compute.nova.API {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] config_dir                     = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] config_source                  = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] control_exchange               = openstack {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] debug                          = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] default_availability_zone      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] default_group_type             = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] default_volume_type            = QuobyteHD {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] disk_geometry                  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] driver_client_cert             = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] driver_client_cert_key         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] driver_data_namespace          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] driver_ssl_cert_path           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] driver_ssl_cert_verify         = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] driver_use_ssl                 = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] enable_new_services            = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] enable_unsupported_driver      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] enabled_backends               = ['QuobyteHD'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] enforce_multipath_for_image_xfer = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] filter_function                = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_api_insecure            = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_api_servers             = ['http://192.168.122.119/image'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_api_ssl_compression     = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_ca_certificates_file    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_catalog_info            = image:glance:publicURL {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_certfile                = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_keyfile                 = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_num_retries             = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance_request_timeout         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] goodness_function              = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] graceful_shutdown_timeout      = 5 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] group_api_class                = cinder.group.api.API {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] host                           = devstack {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_compress_on_upload       = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_conversion_address_space_limit = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_conversion_cpu_limit     = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_conversion_disable       = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_upload_use_cinder_backend = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_upload_use_internal_tenant = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_volume_cache_enabled     = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_volume_cache_max_count   = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] image_volume_cache_max_size_gb = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] init_host_max_objects_retrieval = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] instance_format                = [instance: %(uuid)s]  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] iscsi_target_flags             =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] iscsi_write_cache              = on {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] iser_helper                    = tgtadm {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] iser_ip_address                = 192.168.122.119 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] iser_port                      = 3260 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_color                      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_config_append              = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_dir                        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_file                       = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_options                    = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_rotate_interval            = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_rotate_interval_type       = days {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] log_rotation_type              = none {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] max_age                        = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] max_logfile_count              = 30 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] max_logfile_size_mb            = 200 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] max_over_subscription_ratio    = 20.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] message_reap_interval          = 86400 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] message_ttl                    = 2592000 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] migration_create_volume_timeout_secs = 300 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] monkey_patch                   = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] monkey_patch_modules           = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] my_ip                          = 192.168.122.119 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] no_snapshot_gb_quota           = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] num_iser_scan_tries            = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] num_shell_tries                = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] num_volume_device_scan_tries   = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] nvmeof_conn_info_version       = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] nvmet_ns_id                    = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] nvmet_port_id                  = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_max_limit                = 1000 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_volume_ext_list          = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_volume_listen_port       = 8776 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_volume_use_ssl           = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] osapi_volume_workers           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] per_volume_size_limit          = -1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] periodic_fuzzy_delay           = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] periodic_interval              = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94563) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] public_endpoint                = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] publish_errors                 = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_backup_gigabytes         = 1000 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_backups                  = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_gigabytes                = 1000 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_groups                   = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_snapshots                = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] quota_volumes                  = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] rate_limit_burst               = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] rate_limit_except_level        = CRITICAL {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] rate_limit_interval            = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] reinit_driver_count            = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] replication_device             = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] report_discard_supported       = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] report_interval                = 120 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] reservation_clean_interval     = 86400 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] reservation_expire             = 86400 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] reserved_image_namespaces      = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] reserved_percentage            = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] rpc_response_timeout           = 120 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] run_external_periodic_tasks    = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] scst_target_driver             = iscsi {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] scst_target_iqn_name           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_down_time              = 720 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] shell_completion               = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] snapshot_name_template         = snapshot-%s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] split_loggers                  = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] state_path                     = /opt/stack/data/cinder {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] storage_availability_zone      = nova {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] storage_protocol               = iSCSI {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] syslog_log_facility            = LOG_USER {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] target_helper                  = lioadm {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] target_ip_address              = 192.168.122.119 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] target_port                    = 3260 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] target_protocol                = iscsi {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] target_secondary_ip_addresses  = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] trace_flags                    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] transport_url                  = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] until_refresh                  = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_chap_auth                  = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_default_quota_class        = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_journal                    = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_json                       = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_multipath_for_image_xfer   = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_stderr                     = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] use_syslog                     = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] verify_glance_signatures       = enabled {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_api_class               = cinder.volume.api.API {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_backend_name            = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_clear                   = zero {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_clear_ionice            = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_clear_size              = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_copy_bps_limit          = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_dd_blocksize            = 1M {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_name_template           = volume-%s {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_service_inithost_offload = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volume_usage_audit_period      = month {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] zoning_mode                    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_concurrency.disable_process_locking = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.auth_section = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.auth_type   = password {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.auth_version = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.cache       = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.certfile    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.include_service_catalog = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.insecure    = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.interface   = public {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.keyfile     = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_password =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcache_username =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.region_name = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.service_type = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.backend                  = dogpile.cache.null {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.backend_argument         = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.backend_expiration_time  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.config_prefix            = cache.oslo {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.debug_cache_backend      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.enable_retry_client      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.enable_socket_keepalive  = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.enabled                  = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.expiration_time          = 600 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.hashclient_retry_attempts = 2 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_dead_retry      = 300 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_pool_maxsize    = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_sasl_enabled    = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.password                 = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.proxies                  = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.redis_db                 = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.redis_server             = localhost:6379 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.retry_attempts           = 2 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.retry_delay              = 0.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.socket_keepalive_count   = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.socket_keepalive_idle    = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.socket_keepalive_interval = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.socket_timeout           = 1.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.tls_allowed_ciphers      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.tls_cafile               = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.tls_certfile             = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.tls_enabled              = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.tls_keyfile              = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cache.username                 = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] coordination.backend_url       = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.asyncio_connection    = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.asyncio_slave_connection = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.backend               = sqlalchemy {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.connection            = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.connection_debug      = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.connection_parameters =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.connection_recycle_time = 3600 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.connection_trace      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.db_inc_retry_interval = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.db_max_retries        = 20 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.db_max_retry_interval = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.db_retry_interval     = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.max_overflow          = 50 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.max_pool_size         = 5 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.max_retries           = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94563) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.mysql_wsrep_sync_wait = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.pool_timeout          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.retry_interval        = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.slave_connection      = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.sqlite_synchronous    = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.synchronous_reader    = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Running cmd (subprocess): mount.quobyte {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] database.use_db_reconnect      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.connection_string     = messaging:// {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.enabled               = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.es_doc_type           = notification {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.es_scroll_size        = 10000 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.es_scroll_time        = 2m {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.filter_error_trace    = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.hmac_keys             = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.sentinel_service_name = mymaster {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.socket_timeout        = 0.1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.trace_requests        = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler.trace_sqlalchemy      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler_jaeger.process_tags   = {} {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler_jaeger.service_name_prefix = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] profiler_otlp.service_name_prefix = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.enforce_new_defaults = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: WARNING oslo_config.cfg [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.enforce_scope      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.policy_default_rule = default {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.policy_file        = policy.yaml {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.group          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.helper_command = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] privsep_osbrick.user           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.group         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.helper_command = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] cinder_sys_admin.user          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.auth_section      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.auth_type         = password {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.cafile            = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.certfile          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.collect_timing    = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.insecure          = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.keyfile           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.send_service_user_token = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.split_loggers     = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] service_user.timeout           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.auth_section            = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.auth_type               = password {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.certfile                = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.collect_timing          = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.insecure                = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.keyfile                 = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.region_name             = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.split_loggers           = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] glance.timeout                 = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.backend_availability_zone = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.chap_password = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.chap_username =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.disk_geometry = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.driver_client_cert = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.driver_client_cert_key = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.driver_data_namespace = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.driver_use_ssl = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.extra_capabilities = {} {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.filter_function = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.goodness_function = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.iscsi_target_flags =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.iscsi_write_cache = on {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.iser_helper   = tgtadm {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.iser_port     = 3260 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_host      =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_login     = admin {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_mount_options = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_password  = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_private_key =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_share_path =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.num_shell_tries = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.quobyte_volume_url = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.replication_device = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.report_discard_supported = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.reserved_percentage = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.target_helper = tgtadm {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.target_port   = 3260 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.target_protocol = iscsi {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.trace_flags   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.unique_fqdn_network = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.use_chap_auth = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_backend_name = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_clear  = zero {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_clear_ionice = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_clear_size = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_reports.file_event_handler = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_reports.log_dir           = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.backend_availability_zone = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.backend_host         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.chap_password        = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.chap_username        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.chiscsi_conf         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.disk_geometry        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.driver_client_cert   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.driver_data_namespace = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.driver_use_ssl       = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.extra_capabilities   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.filter_function      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.goodness_function    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack quobyte-client[94564]: Reading configuration file: /etc/quobyte/client.cfg
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.iser_helper          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.iser_ip_address      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack quobyte-client[94564]: Invalid parameters found, error: missing mount point.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.iser_port            = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.iser_target_prefix   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_host             = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_login            = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_mount_options    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_password         = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack quobyte-client[94564]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_private_key      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_share_path       = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_ssh_port         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack quobyte-client[94564]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.num_shell_tries      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.nvmet_port_id        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.replication_device   = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.report_discard_supported = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.reserved_percentage  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.scst_target_driver   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.storage_protocol     = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.target_helper        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.target_ip_address    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.target_port          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.target_prefix        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.target_protocol      = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.trace_flags          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.use_chap_auth        = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_clear         = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_clear_size    = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] QuobyteHD.volumes_dir          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl      = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_notifications.driver = [] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_notifications.retry = -1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] key_manager.fixed_key          = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.barbican_api_version  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.barbican_endpoint     = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.barbican_endpoint_type = public {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.barbican_region_name  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.cafile                = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.certfile              = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.collect_timing        = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.insecure              = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.keyfile               = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.number_of_retries     = 60 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.retry_delay           = 1 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.send_service_user_token = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.split_loggers         = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.timeout               = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.verify_ssl            = True {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican.verify_ssl_path       = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.auth_section = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.auth_type = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.cafile   = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.certfile = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.collect_timing = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.insecure = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.keyfile  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.split_loggers = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] barbican_service_user.timeout  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.approle_role_id          = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.approle_secret_id        = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.kv_mountpoint            = secret {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.kv_path                  = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.kv_version               = 2 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.namespace                = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.root_token_id            = **** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.ssl_ca_crt_file          = None {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.timeout                  = 60.0 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.use_ssl                  = False {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 00:19:44 devstack cinder-volume[94259]: DEBUG oslo_service.backend._eventlet.service [None req-a78775f5-c41f-4851-85b0-d209a5298497 None None] ******************************************************************************** {{(pid=94259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 26 00:19:44 devstack sudo[94573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:44 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:45 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.645s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:45 devstack cinder-volume[94563]: INFO cinder.volume.driver [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Driver hasn't implemented _init_vendor_properties()
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG cinder.volume.driver [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94563) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writer thread running {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG cinder.db.api [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Building query based on filter {{(pid=94563) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94563) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:45 devstack cinder-volume[94563]: INFO cinder.keymgr.migration [None req-8826a9b6-3411-4766-a97d-5080a2f98f87 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 26 00:19:45 devstack sudo[94592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:45 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:46 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.619s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:19:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Driver initialization completed successfully.
Jun 26 00:19:46 devstack cinder-volume[94563]: INFO cinder.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Initiating service 3 cleanup
Jun 26 00:19:46 devstack cinder-volume[94563]: INFO cinder.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Service 3 cleanup completed.
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG cinder.service [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Creating RPC server for service cinder-volume {{(pid=94563) start /opt/stack/cinder/cinder/service.py:231}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG cinder.service [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94563) start /opt/stack/cinder/cinder/service.py:237}}
Jun 26 00:19:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:19:46 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:19:46 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:19:46 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Jun 26 00:19:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.614s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:19:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5f8f6875-dfca-4f87-91af-99f878c5fe1b None None] Driver post RPC initialization completed successfully.
Jun 26 00:19:54 devstack cinder-volume[94259]: DEBUG dbcounter [-] [94259] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:19:56 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:19:56 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:20:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:20:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 6 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:20:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:20:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cebbc8f7-14ef-47ae-896d-abbd6d20f4ff tempest-GroupSnapshotsV319Test-1772749991 None] Group tempest-GroupSnapshotsV319Test-Group-1036520233: creating
Jun 26 00:20:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cebbc8f7-14ef-47ae-896d-abbd6d20f4ff tempest-GroupSnapshotsV319Test-1772749991 None] Group tempest-GroupSnapshotsV319Test-Group-1036520233: created successfully
Jun 26 00:20:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cebbc8f7-14ef-47ae-896d-abbd6d20f4ff tempest-GroupSnapshotsV319Test-1772749991 None] Create group completed successfully.
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Flow 'volume_create_manager' (f17f047b-c40e-4735-afee-147fda502147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6539ba-c9f5-4af6-b1d5-233a6d0dfd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6539ba-c9f5-4af6-b1d5-233a6d0dfd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078296924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d9541d5-df60-4fd2-a623-d49dbaf881fc,host='devstack@QuobyteHD#QuobyteHD',id=53cc7e40-39a8-4c38-8467-e9dae52125a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87922a67b1fe4bda82eb56be34190112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:20:45Z,use_quota=True,user_id='ccbd512710c24646a2f1fe8203cbed54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8525d66c-50d3-4d11-b221-58296ca45b3d),volume_type_id=8525d66c-50d3-4d11-b221-58296ca45b3d)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3654ff-8a6b-4f9f-ab7e-310214749145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3654ff-8a6b-4f9f-ab7e-310214749145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f45a34-7549-47d1-8492-4e0a8fe24f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f45a34-7549-47d1-8492-4e0a8fe24f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cc7e40-39a8-4c38-8467-e9dae52125a7', 'volume_name': 'volume-53cc7e40-39a8-4c38-8467-e9dae52125a7', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7512029-9eab-4893-81a9-73e5c78f045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7512029-9eab-4893-81a9-73e5c78f045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a36354-fbc5-4a84-b403-2f55de9a2043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:20:44 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Volume 53cc7e40-39a8-4c38-8467-e9dae52125a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cc7e40-39a8-4c38-8467-e9dae52125a7', 'volume_size': 1}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d9541d5-df60-4fd2-a623-d49dbaf881fc,created_at=2026-06-25T22:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078296924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d9541d5-df60-4fd2-a623-d49dbaf881fc,host='devstack@QuobyteHD#QuobyteHD',id=53cc7e40-39a8-4c38-8467-e9dae52125a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87922a67b1fe4bda82eb56be34190112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:20:45Z,use_quota=True,user_id='ccbd512710c24646a2f1fe8203cbed54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8525d66c-50d3-4d11-b221-58296ca45b3d),volume_type_id=8525d66c-50d3-4d11-b221-58296ca45b3d)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Creating volume 53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:20:44 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:20:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:45 devstack sudo[94971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 1073741824
Jun 26 00:20:45 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:46 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 1073741824" returned: 0 in 1.185s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:46 devstack sudo[95296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7
Jun 26 00:20:46 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:46 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7" returned: 0 in 0.755s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a36354-fbc5-4a84-b403-2f55de9a2043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cc7e40-39a8-4c38-8467-e9dae52125a7', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69185d6f-09ad-45b5-ad6b-41d2f5f15e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:20:46 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Volume volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 (53cc7e40-39a8-4c38-8467-e9dae52125a7): created successfully
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69185d6f-09ad-45b5-ad6b-41d2f5f15e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:20:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Flow 'volume_create_manager' (f17f047b-c40e-4735-afee-147fda502147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:20:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5dea8ab1-ac3d-434a-b22b-9b79bc444aba tempest-GroupSnapshotsV319Test-1772749991 None] Created volume successfully.
Jun 26 00:20:47 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] GroupSnapshot 4deb679c-7d26-42ca-8445-69898bc54754: creating.
Jun 26 00:20:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Group snapshot 4deb679c-7d26-42ca-8445-69898bc54754: creating. {{(pid=94563) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 00:20:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:20:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:20:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Creating offline snapshot 6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 of volume 53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:20:47 devstack cinder-volume[94563]: INFO oslo.privsep.daemon [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi1tejwyh/privsep.sock']
Jun 26 00:20:47 devstack sudo[95308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi1tejwyh/privsep.sock
Jun 26 00:20:47 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 00:20:48 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 00:20:49 devstack cinder-volume[94563]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 26 00:20:49 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:49 devstack cinder-volume[94563]: INFO oslo.privsep.daemon [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Spawned new privsep daemon via rootwrap
Jun 26 00:20:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Accepted privsep connection to /tmp/tmpi1tejwyh/privsep.sock {{(pid=94563) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jun 26 00:20:49 devstack cinder-volume[94563]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 26 00:20:49 devstack cinder-volume[94563]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 26 00:20:49 devstack cinder-volume[94563]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 26 00:20:49 devstack cinder-volume[94563]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95369
Jun 26 00:20:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33eede5-68bf-43f0-9226-929fa766498d]: (2,) {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:20:50 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a6bb09-0319-4bdb-ac16-b35ac2b6cb44]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:20:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:50 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7
Jun 26 00:20:50 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:51 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7" returned: 0 in 1.441s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:51 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 1G
Jun 26 00:20:51 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:52 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 1G" returned: 0 in 1.246s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:52 devstack sudo[95414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8
Jun 26 00:20:52 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:53 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" returned: 0 in 0.890s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:53 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:20:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:53 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8
Jun 26 00:20:53 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:54 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" returned: 0 in 1.028s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:54 devstack sudo[95432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info
Jun 26 00:20:54 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:55 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info" returned: 0 in 0.874s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:55 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:20:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:55 devstack sudo[95438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info
Jun 26 00:20:55 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:56 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.info" returned: 0 in 0.917s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.952s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:20:56 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-85a666bb-ed3c-4191-914d-5220421f5e32 tempest-GroupSnapshotsV319Test-1772749991 None] group_snapshot 4deb679c-7d26-42ca-8445-69898bc54754: created successfully
Jun 26 00:20:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] group_snapshot 4deb679c-7d26-42ca-8445-69898bc54754: deleting
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] group_snapshot 4deb679c-7d26-42ca-8445-69898bc54754: deleting {{(pid=94563) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "cinder-quobyte-53cc7e40-39a8-4c38-8467-e9dae52125a7" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Lock "cinder-quobyte-53cc7e40-39a8-4c38-8467-e9dae52125a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "cinder-quobyte-6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Lock "cinder-quobyte-6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Deleting offline snapshot 6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 of volume 53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] snapshot_file for this snap is: volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[457a0c30-067d-4121-ae08-f80cd235db6d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:20:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:57 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8
Jun 26 00:20:57 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:58 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" returned: 0 in 0.917s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53cc7e40-39a8-4c38-8467-e9dae52125a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:20:58 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2cc9e5-c6ef-43f6-949e-842aa8f075c6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:20:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:58 devstack sudo[95503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7
Jun 26 00:20:58 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:20:59 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root
Jun 26 00:20:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7" returned: 0 in 0.787s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:20:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:20:59 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8
Jun 26 00:20:59 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:00 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" returned: 0 in 1.158s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:00 devstack sudo[95562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8
Jun 26 00:21:00 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:01 devstack sudo[95582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:01 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:02 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7.6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" returned: 0 in 2.051s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Lock "cinder-quobyte-6d4b7d41-c8de-4df1-8dc0-c71d8ef426f8" released by "_delete_snapshot" :: held 5.094s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Lock "cinder-quobyte-53cc7e40-39a8-4c38-8467-e9dae52125a7" released by "delete_snapshot" :: held 5.134s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:02 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.985s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 8 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:21:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:21:03 devstack cinder-volume[94563]: WARNING cinder.quota [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1356792994 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1356792994, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:03 devstack cinder-volume[94563]: WARNING cinder.quota [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1356792994 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1356792994, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:03 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] Created reservations ['d0fb30cc-8a1a-49da-8dbf-0f393a7323eb', 'ad3cc939-650c-43f8-a14c-30561dbb04a1', '367fd686-605a-4ebb-89d1-260cd363a14c', '4a8e6ff6-30a0-4a04-8f66-7a1877ef9d93'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-90635da5-1d8c-44e3-ac26-73b8f0636a2e tempest-GroupSnapshotsV319Test-1772749991 None] group_snapshot 4deb679c-7d26-42ca-8445-69898bc54754: deleted successfully
Jun 26 00:21:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "cinder-quobyte-53cc7e40-39a8-4c38-8467-e9dae52125a7" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Lock "cinder-quobyte-53cc7e40-39a8-4c38-8467-e9dae52125a7" acquired by "delete_volume" :: waited 0.050s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:04 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8e5ea-ded4-4472-85fe-ca7e2df9a9d0]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:04 devstack sudo[95631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7
Jun 26 00:21:04 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:05 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7" returned: 0 in 1.417s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:05 devstack sudo[95637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7
Jun 26 00:21:05 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Flow 'volume_create_manager' (f7e2eeb2-d807-4693-be9d-0f2a09cf0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107351ff-6d7c-4d3d-b759-a8db65915334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107351ff-6d7c-4d3d-b759-a8db65915334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-923724664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dd145a-6060-4eb8-bad1-537fd3f8f449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee0f7af20a9649c7940a6694d0bb874c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:06Z,use_quota=True,user_id='f4626bb4176a46799a57ad353a5e5830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1156852-6459-4303-93b7-6dda571b7a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1156852-6459-4303-93b7-6dda571b7a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed017e1e-77d5-4682-a10c-fa50473b6151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed017e1e-77d5-4682-a10c-fa50473b6151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08dd145a-6060-4eb8-bad1-537fd3f8f449', 'volume_name': 'volume-08dd145a-6060-4eb8-bad1-537fd3f8f449', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2618f389-8653-41fb-8cec-a2fa4216b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2618f389-8653-41fb-8cec-a2fa4216b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f493685-73dc-47a2-b077-622b09ccbf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:06 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Volume 08dd145a-6060-4eb8-bad1-537fd3f8f449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08dd145a-6060-4eb8-bad1-537fd3f8f449', 'volume_size': 1}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-923724664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dd145a-6060-4eb8-bad1-537fd3f8f449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee0f7af20a9649c7940a6694d0bb874c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:06Z,use_quota=True,user_id='f4626bb4176a46799a57ad353a5e5830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Creating volume 08dd145a-6060-4eb8-bad1-537fd3f8f449 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:21:06 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:21:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:06 devstack sudo[95639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 1073741824
Jun 26 00:21:06 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:07 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-53cc7e40-39a8-4c38-8467-e9dae52125a7" returned: 0 in 1.427s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Lock "cinder-quobyte-53cc7e40-39a8-4c38-8467-e9dae52125a7" released by "delete_volume" :: held 3.044s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Created reservations ['c6fe7363-a497-4557-abba-ccd17b5065d2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:07 devstack cinder-volume[94563]: WARNING cinder.quota [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1356792994 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1356792994, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Created reservations ['94256524-02a9-4d9b-94d7-7e88d45af8cc', '2b7699f4-5fe1-432a-ade1-09e9fb68eef6', 'cf889495-00a4-47e2-b6ca-e8ee42d566f8', 'd6d4cde2-9c0e-48df-9d5f-90d2f4a73e76'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:07 devstack sudo[95646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:07 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Flow 'volume_create_manager' (49d71b72-622d-4f5a-90ff-e944eab42d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f85bbc-d939-43bf-b61f-813022084cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f85bbc-d939-43bf-b61f-813022084cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-899977177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0acc74-c66a-4fb2-9524-9223e05a9e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc78bace2574032ba994f94ad88f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:08Z,use_quota=True,user_id='a3ae65975de14845a7da03a6770edb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2964701-cd59-48ed-90aa-8fe2fe1e27e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2964701-cd59-48ed-90aa-8fe2fe1e27e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cf864a-8eef-4076-83ae-0cfe50246739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cf864a-8eef-4076-83ae-0cfe50246739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0acc74-c66a-4fb2-9524-9223e05a9e20', 'volume_name': 'volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3202fd-b639-42b6-bf39-0acffc8fe78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3202fd-b639-42b6-bf39-0acffc8fe78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1233894-1a28-4f30-a73f-46aadcc66ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:07 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Volume 8c0acc74-c66a-4fb2-9524-9223e05a9e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20', 'volume_size': 1}
Jun 26 00:21:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:08 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 1073741824" returned: 0 in 1.833s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:08 devstack sudo[95648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449
Jun 26 00:21:08 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:09 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.594s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:09 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e2c19bc4-1187-445c-ae3b-fe8d697fa022 tempest-GroupSnapshotsV319Test-1772749991 None] Delete group completed successfully.
Jun 26 00:21:09 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449" returned: 0 in 1.427s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] <== create_volume: return (3356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.363s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-899977177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0acc74-c66a-4fb2-9524-9223e05a9e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc78bace2574032ba994f94ad88f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:08Z,use_quota=True,user_id='a3ae65975de14845a7da03a6770edb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Creating volume 8c0acc74-c66a-4fb2-9524-9223e05a9e20 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:21:09 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f493685-73dc-47a2-b077-622b09ccbf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08dd145a-6060-4eb8-bad1-537fd3f8f449', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514640db-5129-4fb4-8e4a-e637007feb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:09 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 1073741824
Jun 26 00:21:09 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Volume volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 (08dd145a-6060-4eb8-bad1-537fd3f8f449): created successfully
Jun 26 00:21:09 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514640db-5129-4fb4-8e4a-e637007feb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Flow 'volume_create_manager' (f7e2eeb2-d807-4693-be9d-0f2a09cf0e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:09 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6630b158-4c4f-4265-8488-fc6a0c80b6a5 tempest-DeleteServersTestJSON-316868318 None] Created volume successfully.
Jun 26 00:21:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 1073741824" returned: 0 in 1.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:11 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:11 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20
Jun 26 00:21:11 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:13 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20" returned: 0 in 1.761s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] <== create_volume: return (3766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.772s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1233894-1a28-4f30-a73f-46aadcc66ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3123de-33d6-42df-adec-0f6fbae748ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:13 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Volume volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 (8c0acc74-c66a-4fb2-9524-9223e05a9e20): created successfully
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3123de-33d6-42df-adec-0f6fbae748ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Flow 'volume_create_manager' (49d71b72-622d-4f5a-90ff-e944eab42d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8680f3e5-7f14-43de-a694-690ec66fd857 tempest-VolumesAdminNegativeTest-1862294884 None] Created volume successfully.
Jun 26 00:21:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Acquiring lock "cinder-8c0acc74-c66a-4fb2-9524-9223e05a9e20-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Lock "cinder-8c0acc74-c66a-4fb2-9524-9223e05a9e20-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Acquiring lock "cinder-quobyte-8c0acc74-c66a-4fb2-9524-9223e05a9e20" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Lock "cinder-quobyte-8c0acc74-c66a-4fb2-9524-9223e05a9e20" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[30022b89-36a8-4ed7-ac9e-e88c06643db4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:16 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20
Jun 26 00:21:16 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:18 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20" returned: 0 in 1.782s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:18 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20
Jun 26 00:21:18 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:19 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8c0acc74-c66a-4fb2-9524-9223e05a9e20" returned: 0 in 1.588s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Lock "cinder-quobyte-8c0acc74-c66a-4fb2-9524-9223e05a9e20" released by "delete_volume" :: held 3.546s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:19 devstack cinder-volume[94563]: WARNING cinder.quota [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:19 devstack cinder-volume[94563]: WARNING cinder.quota [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:19 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Created reservations ['fa31910d-8278-4471-accc-d9a553d1722a', '5c30dcae-adb4-4e3a-9c65-8cfb86749efd', 'd8bd574d-a4d6-4f9c-840a-0e9aea53e326', 'f14dffcd-54d6-40af-be13-71b09627c53b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:20 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:20 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:20 devstack cinder-volume[94563]: WARNING py.warnings [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jun 26 00:21:20 devstack cinder-volume[94563]:   .first()
Jun 26 00:21:20 devstack cinder-volume[94563]: 
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fcb460-a20e-40f2-b14e-48e5aa492358]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:21 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449
Jun 26 00:21:21 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:21 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-87a2974e-ee8b-4c9f-a9b3-e8236bc642f3 tempest-GroupsTest-213265280 None] Group tempest-Group1-2031716719: creating
Jun 26 00:21:21 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-87a2974e-ee8b-4c9f-a9b3-e8236bc642f3 tempest-GroupsTest-213265280 None] Group tempest-Group1-2031716719: created successfully
Jun 26 00:21:21 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-87a2974e-ee8b-4c9f-a9b3-e8236bc642f3 tempest-GroupsTest-213265280 None] Create group completed successfully.
Jun 26 00:21:21 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.286s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:21 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:21 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Deleted volume successfully.
Jun 26 00:21:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ca838b0a-0f7a-45da-bdba-d58e705aad5b tempest-VolumesAdminNegativeTest-1862294884 None] Lock "cinder-8c0acc74-c66a-4fb2-9524-9223e05a9e20-delete_volume" released by "delete_volume" :: held 5.335s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:22 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449" returned: 0 in 1.318s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.347s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-08dd145a-6060-4eb8-bad1-537fd3f8f449', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b9153b4-6b7c-4624-a61a-b73fbd601908', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:21:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-ce793b66-289a-43d4-96e8-28a6e30ecb66 req-545829b4-9354-4579-b596-6ace14c2b358 tempest-DeleteServersTestJSON-316868318 None] attachment_update completed successfully.
Jun 26 00:21:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-676633dd-aa37-42cb-837d-a8e6d6cabd37 tempest-GroupsTest-213265280 None] Group tempest-Group2-719651731: creating
Jun 26 00:21:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-676633dd-aa37-42cb-837d-a8e6d6cabd37 tempest-GroupsTest-213265280 None] Group tempest-Group2-719651731: created successfully
Jun 26 00:21:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-676633dd-aa37-42cb-837d-a8e6d6cabd37 tempest-GroupsTest-213265280 None] Create group completed successfully.
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Flow 'volume_create_manager' (0b4a1b42-c1c6-4b62-bf11-991d9568c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89692496-3dea-4b68-bcae-87c50b010852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89692496-3dea-4b68-bcae-87c50b010852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150166320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=991b0c48-1982-4cba-9994-692e8f3b6d04,host='devstack@QuobyteHD#QuobyteHD',id=c2080379-77e2-449a-823d-044abad36be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0dce539d58499aa45acbe9a86d862b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:24Z,use_quota=True,user_id='8cd5bc98f199418d9765981895f0aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdb0e159-e727-4009-863a-a626a2af7d44),volume_type_id=bdb0e159-e727-4009-863a-a626a2af7d44)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3495c362-fd44-4091-8979-93608854baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3495c362-fd44-4091-8979-93608854baf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07199fb-3527-476e-b3ed-a190062154c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07199fb-3527-476e-b3ed-a190062154c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2080379-77e2-449a-823d-044abad36be0', 'volume_name': 'volume-c2080379-77e2-449a-823d-044abad36be0', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4717f625-4fee-4a0a-a1ee-83aeac2f81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4717f625-4fee-4a0a-a1ee-83aeac2f81c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c5f565-b895-48f6-98a8-8a9e14a8f41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Volume c2080379-77e2-449a-823d-044abad36be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2080379-77e2-449a-823d-044abad36be0', 'volume_size': 1}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=991b0c48-1982-4cba-9994-692e8f3b6d04,created_at=2026-06-25T22:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150166320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=991b0c48-1982-4cba-9994-692e8f3b6d04,host='devstack@QuobyteHD#QuobyteHD',id=c2080379-77e2-449a-823d-044abad36be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0dce539d58499aa45acbe9a86d862b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:24Z,use_quota=True,user_id='8cd5bc98f199418d9765981895f0aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdb0e159-e727-4009-863a-a626a2af7d44),volume_type_id=bdb0e159-e727-4009-863a-a626a2af7d44)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Creating volume c2080379-77e2-449a-823d-044abad36be0 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:21:24 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:21:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:24 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0 1073741824
Jun 26 00:21:24 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:25 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0 1073741824" returned: 0 in 0.916s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:25 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0
Jun 26 00:21:25 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:26 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0" returned: 0 in 0.783s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c5f565-b895-48f6-98a8-8a9e14a8f41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2080379-77e2-449a-823d-044abad36be0', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0573487-97c7-4a89-80fc-886e09b64dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Volume volume-c2080379-77e2-449a-823d-044abad36be0 (c2080379-77e2-449a-823d-044abad36be0): created successfully
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0573487-97c7-4a89-80fc-886e09b64dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Flow 'volume_create_manager' (0b4a1b42-c1c6-4b62-bf11-991d9568c263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-11695bc3-b694-422a-ba18-4489d8c9a342 tempest-GroupsTest-213265280 None] Created volume successfully.
Jun 26 00:21:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Acquiring lock "cinder-quobyte-c2080379-77e2-449a-823d-044abad36be0" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Lock "cinder-quobyte-c2080379-77e2-449a-823d-044abad36be0" acquired by "delete_volume" :: waited 0.038s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[75834ca8-56c2-44b4-9d38-925526f81163]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:27 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0
Jun 26 00:21:27 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:28 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0" returned: 0 in 0.892s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:28 devstack sudo[96276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0
Jun 26 00:21:28 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:29 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2080379-77e2-449a-823d-044abad36be0" returned: 0 in 0.999s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Lock "cinder-quobyte-c2080379-77e2-449a-823d-044abad36be0" released by "delete_volume" :: held 1.990s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Created reservations ['26b8b33c-3ecd-46cb-9223-fce25140a094'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:29 devstack cinder-volume[94563]: WARNING cinder.quota [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1874146593 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1874146593, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:29 devstack cinder-volume[94563]: WARNING cinder.quota [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1874146593 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1874146593, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Created reservations ['e2efe354-8226-4ade-95ff-04d9957cfaf6', '71887cd2-6635-48c7-aebd-a5c7abbb3a1e', '5dc0878e-5d4e-437c-a67e-74c34300bdb9', 'f9773834-59a7-401b-8d49-8467217d0a55'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:29 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:29 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Created reservations ['be160e33-64e2-457d-85be-8e0d348ccfd9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:30 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:30 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:30 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.859s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:30 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0c63f354-0ccc-46e1-845e-b9b0a8f32bd9 tempest-GroupsTest-213265280 None] Delete group completed successfully.
Jun 26 00:21:31 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.738s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:31 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:31 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-43a037b0-01dd-42c5-b5f2-cd28d5c3e556 tempest-GroupsTest-213265280 None] Delete group completed successfully.
Jun 26 00:21:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-947adfe6-23aa-4e04-80e7-bd2f83c7a6b4 tempest-GroupsTest-213265280 None] Group tempest-GroupsTest-Group-1545546864: creating
Jun 26 00:21:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-947adfe6-23aa-4e04-80e7-bd2f83c7a6b4 tempest-GroupsTest-213265280 None] Group tempest-GroupsTest-Group-1545546864: created successfully
Jun 26 00:21:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-947adfe6-23aa-4e04-80e7-bd2f83c7a6b4 tempest-GroupsTest-213265280 None] Create group completed successfully.
Jun 26 00:21:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-0e4b8078-c478-44b6-955b-8e9737dc5d53 req-bfcf79db-7e94-41ab-9c17-c77c3a262ede tempest-DeleteServersTestJSON-316868318 None] Terminate volume connection completed successfully.
Jun 26 00:21:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-0e4b8078-c478-44b6-955b-8e9737dc5d53 req-bfcf79db-7e94-41ab-9c17-c77c3a262ede tempest-DeleteServersTestJSON-316868318 None] Deleting attachment 1b9153b4-6b7c-4624-a61a-b73fbd601908. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Flow 'volume_create_manager' (f8c459d7-0104-421b-8ec1-b96434099d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d38f3e7-88ca-4284-a1af-80f28c55e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d38f3e7-88ca-4284-a1af-80f28c55e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265757112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b1ce64d-97e0-4dce-b371-358751aeabf9,host='devstack@QuobyteHD#QuobyteHD',id=ac77b576-7c04-4726-81d9-0dab29be1aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0dce539d58499aa45acbe9a86d862b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:34Z,use_quota=True,user_id='8cd5bc98f199418d9765981895f0aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c51896a-8021-40f4-a142-43e1698e6b7e),volume_type_id=5c51896a-8021-40f4-a142-43e1698e6b7e)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b5150a-04f2-4b9b-9e7b-f9395a39fb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b5150a-04f2-4b9b-9e7b-f9395a39fb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e7dd3f-7b43-4a59-83bd-e1ff9c800b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e7dd3f-7b43-4a59-83bd-e1ff9c800b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac77b576-7c04-4726-81d9-0dab29be1aed', 'volume_name': 'volume-ac77b576-7c04-4726-81d9-0dab29be1aed', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7485e3-2963-4399-b7ed-7890f2cdf909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7485e3-2963-4399-b7ed-7890f2cdf909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a33458-ace3-473a-a0af-163e63b6553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Volume ac77b576-7c04-4726-81d9-0dab29be1aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac77b576-7c04-4726-81d9-0dab29be1aed', 'volume_size': 1}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7b1ce64d-97e0-4dce-b371-358751aeabf9,created_at=2026-06-25T22:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265757112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b1ce64d-97e0-4dce-b371-358751aeabf9,host='devstack@QuobyteHD#QuobyteHD',id=ac77b576-7c04-4726-81d9-0dab29be1aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0dce539d58499aa45acbe9a86d862b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:34Z,use_quota=True,user_id='8cd5bc98f199418d9765981895f0aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c51896a-8021-40f4-a142-43e1698e6b7e),volume_type_id=5c51896a-8021-40f4-a142-43e1698e6b7e)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Creating volume ac77b576-7c04-4726-81d9-0dab29be1aed {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:21:34 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:21:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:34 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed 1073741824
Jun 26 00:21:34 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:35 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed 1073741824" returned: 0 in 0.981s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:35 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed
Jun 26 00:21:35 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Acquiring lock "cinder-08dd145a-6060-4eb8-bad1-537fd3f8f449-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Lock "cinder-08dd145a-6060-4eb8-bad1-537fd3f8f449-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Acquiring lock "cinder-quobyte-08dd145a-6060-4eb8-bad1-537fd3f8f449" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Lock "cinder-quobyte-08dd145a-6060-4eb8-bad1-537fd3f8f449" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91b1eb-9115-41d6-87a2-d1a6fec11a35]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:36 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed" returned: 0 in 0.818s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a33458-ace3-473a-a0af-163e63b6553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac77b576-7c04-4726-81d9-0dab29be1aed', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4418a5a5-c3ef-4e95-afde-571544a51158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:36 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449
Jun 26 00:21:36 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:36 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Volume volume-ac77b576-7c04-4726-81d9-0dab29be1aed (ac77b576-7c04-4726-81d9-0dab29be1aed): created successfully
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4418a5a5-c3ef-4e95-afde-571544a51158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Flow 'volume_create_manager' (f8c459d7-0104-421b-8ec1-b96434099d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:36 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=52,cinder:UPDATE=59,cinder:INSERT=10,cinder:DELETE=4 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:21:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3cd25fa4-3ad0-416e-bc7f-3717c37ae6d6 tempest-GroupsTest-213265280 None] Created volume successfully.
Jun 26 00:21:37 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449" returned: 0 in 0.965s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:37 devstack sudo[96400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449
Jun 26 00:21:37 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Flow 'volume_create_manager' (add75eec-219c-488b-96df-437f3c0a8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3214ce-3236-4340-8ce3-a5d1e28e5490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=75,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3214ce-3236-4340-8ce3-a5d1e28e5490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-963212035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b1ce64d-97e0-4dce-b371-358751aeabf9,host='devstack@QuobyteHD#QuobyteHD',id=061aee63-5141-4352-8de2-f0b22b20af59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0dce539d58499aa45acbe9a86d862b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:38Z,use_quota=True,user_id='8cd5bc98f199418d9765981895f0aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c51896a-8021-40f4-a142-43e1698e6b7e),volume_type_id=5c51896a-8021-40f4-a142-43e1698e6b7e)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4aa4ec4-fb8d-4fda-89f1-c507b13dc12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4aa4ec4-fb8d-4fda-89f1-c507b13dc12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a6977-d77d-4c1d-8369-bca81c069a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a6977-d77d-4c1d-8369-bca81c069a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061aee63-5141-4352-8de2-f0b22b20af59', 'volume_name': 'volume-061aee63-5141-4352-8de2-f0b22b20af59', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e8c4f8-5485-4a7b-aa6a-7aa29350f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e8c4f8-5485-4a7b-aa6a-7aa29350f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bdd046-8c51-47c0-8b5d-e8f3826bb049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:37 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Volume 061aee63-5141-4352-8de2-f0b22b20af59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061aee63-5141-4352-8de2-f0b22b20af59', 'volume_size': 1}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7b1ce64d-97e0-4dce-b371-358751aeabf9,created_at=2026-06-25T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-963212035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b1ce64d-97e0-4dce-b371-358751aeabf9,host='devstack@QuobyteHD#QuobyteHD',id=061aee63-5141-4352-8de2-f0b22b20af59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0dce539d58499aa45acbe9a86d862b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:21:38Z,use_quota=True,user_id='8cd5bc98f199418d9765981895f0aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c51896a-8021-40f4-a142-43e1698e6b7e),volume_type_id=5c51896a-8021-40f4-a142-43e1698e6b7e)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Creating volume 061aee63-5141-4352-8de2-f0b22b20af59 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:21:37 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:21:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:37 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59 1073741824
Jun 26 00:21:37 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:38 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-08dd145a-6060-4eb8-bad1-537fd3f8f449" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Lock "cinder-quobyte-08dd145a-6060-4eb8-bad1-537fd3f8f449" released by "delete_volume" :: held 1.857s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Created reservations ['d1a59a5e-f261-4ce7-b0e0-bd0fc339bd7d', 'bea33f8d-ae54-4e1c-a26f-b2eef06a0f57', '254d3c89-bcdf-4a9c-bf72-a74a3dc26bc2', 'fcfa9165-3b6d-4bb5-adc8-7e167a467421'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:38 devstack sudo[96406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:38 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:39 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59 1073741824" returned: 0 in 1.148s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:39 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.846s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:39 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59
Jun 26 00:21:39 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Deleted volume successfully.
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80949045-3d80-4b32-93f9-118124dd11cf tempest-DeleteServersTestJSON-316868318 None] Lock "cinder-08dd145a-6060-4eb8-bad1-537fd3f8f449-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:39 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59" returned: 0 in 0.710s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bdd046-8c51-47c0-8b5d-e8f3826bb049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061aee63-5141-4352-8de2-f0b22b20af59', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208dd587-8b62-47e6-9668-76a20b644ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:21:39 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Volume volume-061aee63-5141-4352-8de2-f0b22b20af59 (061aee63-5141-4352-8de2-f0b22b20af59): created successfully
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208dd587-8b62-47e6-9668-76a20b644ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:21:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Flow 'volume_create_manager' (add75eec-219c-488b-96df-437f3c0a8876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:21:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3aec61d5-d3ad-42aa-bdd3-83dcbc1bbed1 tempest-GroupsTest-213265280 None] Created volume successfully.
Jun 26 00:21:40 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-09b66611-c60e-4fc7-863c-95fc49f272c5 tempest-GroupsTest-213265280 None] Update group completed successfully.
Jun 26 00:21:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b937997c-be3a-438e-9539-de20b8c0566f tempest-GroupsTest-213265280 None] Update group completed successfully.
Jun 26 00:21:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Acquiring lock "cinder-quobyte-061aee63-5141-4352-8de2-f0b22b20af59" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Lock "cinder-quobyte-061aee63-5141-4352-8de2-f0b22b20af59" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:44 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abbea9f-b8bb-4b52-8dc8-ef8fa1d586db]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:45 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59
Jun 26 00:21:45 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:46 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59" returned: 0 in 1.646s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:46 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59
Jun 26 00:21:46 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:47 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-061aee63-5141-4352-8de2-f0b22b20af59" returned: 0 in 1.133s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Lock "cinder-quobyte-061aee63-5141-4352-8de2-f0b22b20af59" released by "delete_volume" :: held 2.875s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Acquiring lock "cinder-quobyte-ac77b576-7c04-4726-81d9-0dab29be1aed" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:21:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Lock "cinder-quobyte-ac77b576-7c04-4726-81d9-0dab29be1aed" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:21:47 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad55280c-39c3-4e70-baea-a87fae828efd]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:21:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:47 devstack sudo[96527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed
Jun 26 00:21:47 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:49 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed" returned: 0 in 1.473s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:49 devstack sudo[96536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed
Jun 26 00:21:49 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:50 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ac77b576-7c04-4726-81d9-0dab29be1aed" returned: 0 in 1.073s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Lock "cinder-quobyte-ac77b576-7c04-4726-81d9-0dab29be1aed" released by "delete_volume" :: held 2.654s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Created reservations ['0fb64c15-e29c-4903-a32c-bc228f3851b5'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:50 devstack cinder-volume[94563]: WARNING cinder.quota [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2020177821 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2020177821, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:50 devstack cinder-volume[94563]: WARNING cinder.quota [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2020177821 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2020177821, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Created reservations ['2c6bbed6-f7c6-45a7-a307-002c5ac0c7a7', 'a4f64a07-d607-4afa-9f89-25bc84a2bba7', '6e01bdc1-39ac-4000-82cd-74eadcb5f05c', 'd30d3fe1-f29a-49d8-a2e6-0fdba90f117a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Created reservations ['d87bb44b-2c6d-4930-b9ad-b983ec4fe389', 'f2dfe7b4-ea90-4b15-b485-7667d876f343', 'e38b82ef-6c1b-4081-9512-bf6109e27a1c', '068616ce-70ab-4f3b-b5e6-359ec3a3e1f2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:21:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:21:50 devstack sudo[96539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:21:50 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:21:52 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root
Jun 26 00:21:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.151s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:21:52 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:21:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5fb0f352-2df6-4dda-8b5d-33c062067051 tempest-GroupsTest-213265280 None] Delete group completed successfully.
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=7 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:01 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:22:01 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:01 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.750s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Flow 'volume_create_manager' (50b6f4f0-f2d8-43cd-9b37-c6ad3b350921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ab356d-427a-4c88-a9a2-3ed479dcf569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ab356d-427a-4c88-a9a2-3ed479dcf569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1994929648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197856a8-2eb8-4ac7-8c73-56e01daba50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b022f49db047e39fa9f3342dbb5364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:08Z,use_quota=True,user_id='dafc283a1e3a46d9b8de29bf1b929032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ebba53-e37b-4f72-9fb7-71db5ea60568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ebba53-e37b-4f72-9fb7-71db5ea60568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0fe520-6a2f-4bd2-8a00-dc5db6a82d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0fe520-6a2f-4bd2-8a00-dc5db6a82d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197856a8-2eb8-4ac7-8c73-56e01daba50b', 'volume_name': 'volume-197856a8-2eb8-4ac7-8c73-56e01daba50b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a21094-53e2-4d3e-a9aa-f36ed889fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a21094-53e2-4d3e-a9aa-f36ed889fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e4d3db-70f7-4eeb-9bee-e9384accf841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:08 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Volume 197856a8-2eb8-4ac7-8c73-56e01daba50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197856a8-2eb8-4ac7-8c73-56e01daba50b', 'volume_size': 1}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1994929648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197856a8-2eb8-4ac7-8c73-56e01daba50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b022f49db047e39fa9f3342dbb5364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:08Z,use_quota=True,user_id='dafc283a1e3a46d9b8de29bf1b929032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Creating volume 197856a8-2eb8-4ac7-8c73-56e01daba50b {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:08 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:08 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b 1073741824
Jun 26 00:22:08 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:09 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b 1073741824" returned: 0 in 1.127s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:09 devstack sudo[96599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b
Jun 26 00:22:09 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Flow 'volume_create_manager' (d2ae5018-797b-4d1d-b96a-5ae6c4be5308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43bd9e2-5326-4c76-9342-0fb2a558c639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43bd9e2-5326-4c76-9342-0fb2a558c639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1000037423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032218e7-78e3-4365-bf16-cb130dd3d0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c36b3633044932a84e98bc3978495d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:10Z,use_quota=True,user_id='deed371470624893bd969c8ed614ccc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1eaf33-242e-4226-8957-b77285aa5509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1eaf33-242e-4226-8957-b77285aa5509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367d6960-e564-42a2-932c-eec71994a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367d6960-e564-42a2-932c-eec71994a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032218e7-78e3-4365-bf16-cb130dd3d0b7', 'volume_name': 'volume-032218e7-78e3-4365-bf16-cb130dd3d0b7', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec630b-8cd5-4bbf-ab1a-8e82f99791df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec630b-8cd5-4bbf-ab1a-8e82f99791df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9f8591-6129-44c2-9220-083ee82c163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:09 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Volume 032218e7-78e3-4365-bf16-cb130dd3d0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032218e7-78e3-4365-bf16-cb130dd3d0b7', 'volume_size': 1}
Jun 26 00:22:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:10 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b" returned: 0 in 0.700s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1000037423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032218e7-78e3-4365-bf16-cb130dd3d0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c36b3633044932a84e98bc3978495d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:10Z,use_quota=True,user_id='deed371470624893bd969c8ed614ccc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Creating volume 032218e7-78e3-4365-bf16-cb130dd3d0b7 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:10 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:10 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 1073741824
Jun 26 00:22:10 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e4d3db-70f7-4eeb-9bee-e9384accf841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197856a8-2eb8-4ac7-8c73-56e01daba50b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584a4f0a-5efd-45bd-a956-8748d8beaf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:10 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Volume volume-197856a8-2eb8-4ac7-8c73-56e01daba50b (197856a8-2eb8-4ac7-8c73-56e01daba50b): created successfully
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584a4f0a-5efd-45bd-a956-8748d8beaf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Flow 'volume_create_manager' (50b6f4f0-f2d8-43cd-9b37-c6ad3b350921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-456872c8-110b-41f5-8199-be0aa25234ed tempest-VolumeQuotasAdminTestJSON-1813265010 None] Created volume successfully.
Jun 26 00:22:11 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 1073741824" returned: 0 in 0.998s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:11 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7
Jun 26 00:22:11 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "cinder-197856a8-2eb8-4ac7-8c73-56e01daba50b-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "cinder-197856a8-2eb8-4ac7-8c73-56e01daba50b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "cinder-quobyte-197856a8-2eb8-4ac7-8c73-56e01daba50b" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "cinder-quobyte-197856a8-2eb8-4ac7-8c73-56e01daba50b" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb34df-890e-4be2-a22a-41fe38bf70aa]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:22:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:11 devstack sudo[96610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b
Jun 26 00:22:11 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:12 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7" returned: 0 in 0.725s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9f8591-6129-44c2-9220-083ee82c163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032218e7-78e3-4365-bf16-cb130dd3d0b7', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d852c5-c3e9-4733-af2d-55489aaed0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:12 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Volume volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 (032218e7-78e3-4365-bf16-cb130dd3d0b7): created successfully
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d852c5-c3e9-4733-af2d-55489aaed0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Flow 'volume_create_manager' (d2ae5018-797b-4d1d-b96a-5ae6c4be5308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-55c9620d-e0bf-4f3b-9cf6-1101fbe89d12 tempest-AttachVolumeShelveTestJSON-884272115 None] Created volume successfully.
Jun 26 00:22:12 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b" returned: 0 in 1.059s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:12 devstack sudo[96620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b
Jun 26 00:22:12 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:13 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-197856a8-2eb8-4ac7-8c73-56e01daba50b" returned: 0 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "cinder-quobyte-197856a8-2eb8-4ac7-8c73-56e01daba50b" released by "delete_volume" :: held 2.100s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Created reservations ['7822fc22-d11b-441d-9846-4fcb21ad8d89', '48171774-c940-4de5-bc3d-6e524bfb9c16', 'fb668a2b-80d5-48b0-af27-1ce892700533', '48c329e1-0bc6-4286-a720-8efb05dc0501'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:13 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:22:13 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:14 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.859s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:14 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:22:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Deleted volume successfully.
Jun 26 00:22:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-eff44fd5-3bfa-4d41-9bb5-222cb5adc3cf tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "cinder-197856a8-2eb8-4ac7-8c73-56e01daba50b-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Flow 'volume_create_manager' (2ed9a8c7-54bb-41d2-92c3-a6f067640194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e248f4-df2b-4d50-96a8-ba63d33aead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e248f4-df2b-4d50-96a8-ba63d33aead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115995950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b43f10c-2cf4-44c4-bae7-d98e6ba2f352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b022f49db047e39fa9f3342dbb5364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:16Z,use_quota=True,user_id='dafc283a1e3a46d9b8de29bf1b929032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d47d70-7628-4a45-9d6c-8197be6d3ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d47d70-7628-4a45-9d6c-8197be6d3ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c06295e-68e6-4885-9da6-c0224cee700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c06295e-68e6-4885-9da6-c0224cee700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b43f10c-2cf4-44c4-bae7-d98e6ba2f352', 'volume_name': 'volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb13fec-d926-456b-8e2e-80cce984a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb13fec-d926-456b-8e2e-80cce984a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f05dd5-130f-4beb-92e1-069b6cbf8158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:15 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Volume 7b43f10c-2cf4-44c4-bae7-d98e6ba2f352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352', 'volume_size': 1}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115995950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b43f10c-2cf4-44c4-bae7-d98e6ba2f352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b022f49db047e39fa9f3342dbb5364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:16Z,use_quota=True,user_id='dafc283a1e3a46d9b8de29bf1b929032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Creating volume 7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:15 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:15 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 1073741824
Jun 26 00:22:15 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:17 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 1073741824" returned: 0 in 1.305s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:17 devstack sudo[96733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352
Jun 26 00:22:17 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:18 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352" returned: 0 in 0.816s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f05dd5-130f-4beb-92e1-069b6cbf8158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4099643-9994-426c-ab0d-bd63dc2e4e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:18 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Volume volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 (7b43f10c-2cf4-44c4-bae7-d98e6ba2f352): created successfully
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4099643-9994-426c-ab0d-bd63dc2e4e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Flow 'volume_create_manager' (2ed9a8c7-54bb-41d2-92c3-a6f067640194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-375f0a99-7a03-4b19-8cdf-d60553f5d4f4 tempest-VolumeQuotasAdminTestJSON-1813265010 None] Created volume successfully.
Jun 26 00:22:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e4d1b5b7-f4e0-4924-b66a-45b3f26ce44d tempest-VolumeQuotasAdminTestJSON-981755540 None] Transfer volume completed successfully.
Jun 26 00:22:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Acquiring lock "cinder-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:22:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Lock "cinder-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:22:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Acquiring lock "cinder-quobyte-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:22:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Lock "cinder-quobyte-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:22:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe7f00-ad6b-4a94-b53d-c6e1964bdb3b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:22:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:21 devstack sudo[96745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352
Jun 26 00:22:21 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:22 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352" returned: 0 in 0.951s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:22 devstack sudo[96750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352
Jun 26 00:22:22 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:23 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352" returned: 0 in 0.978s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Lock "cinder-quobyte-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352" released by "delete_volume" :: held 2.009s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Created reservations ['228b7cdf-dee1-4083-b535-6c9fbc1ad288', '947cfdc8-4c48-4cb8-96f4-8870efd2912e', '5ffd8ad5-3b3d-4bff-ac9d-062495d89535', 'd3571f84-19fa-49f4-b690-efc0b48baa3c'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Flow 'volume_create_manager' (69f761c5-d042-464b-b5de-17981ffee179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1514368f-cde7-4d10-813b-35fc60f189f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1514368f-cde7-4d10-813b-35fc60f189f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1561268936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e489a4f-7080-4031-9dfe-864c9a4992d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc782322417944908a67ad9123de6048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:23Z,use_quota=True,user_id='6218d6ba233948c4b8e4d368dd3c3287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244000b7-e7fa-4be1-a9af-35cee97c6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244000b7-e7fa-4be1-a9af-35cee97c6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fee4741-96f5-40da-979b-5fb874a62349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fee4741-96f5-40da-979b-5fb874a62349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e489a4f-7080-4031-9dfe-864c9a4992d0', 'volume_name': 'volume-2e489a4f-7080-4031-9dfe-864c9a4992d0', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6751cf0d-3c89-480a-be7a-6b669814c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6751cf0d-3c89-480a-be7a-6b669814c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ae8aec-9716-4281-abd6-d68cd15bbb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:23 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Volume 2e489a4f-7080-4031-9dfe-864c9a4992d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e489a4f-7080-4031-9dfe-864c9a4992d0', 'volume_size': 1}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1561268936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e489a4f-7080-4031-9dfe-864c9a4992d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc782322417944908a67ad9123de6048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:23Z,use_quota=True,user_id='6218d6ba233948c4b8e4d368dd3c3287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Creating volume 2e489a4f-7080-4031-9dfe-864c9a4992d0 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:23 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:23 devstack sudo[96765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 1073741824
Jun 26 00:22:23 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:23 devstack sudo[96767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:22:23 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:24 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:24 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:22:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Deleted volume successfully.
Jun 26 00:22:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c02a9b3-4a7b-4b02-a4e9-c8689b7111c7 tempest-VolumeQuotasAdminTestJSON-226811405 None] Lock "cinder-7b43f10c-2cf4-44c4-bae7-d98e6ba2f352-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:22:24 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 1073741824" returned: 0 in 0.884s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:24 devstack sudo[96777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0
Jun 26 00:22:24 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:25 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0" returned: 0 in 0.997s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ae8aec-9716-4281-abd6-d68cd15bbb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e489a4f-7080-4031-9dfe-864c9a4992d0', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0031984a-2ec6-4248-9cf4-cc4dd6972966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:25 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Volume volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 (2e489a4f-7080-4031-9dfe-864c9a4992d0): created successfully
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0031984a-2ec6-4248-9cf4-cc4dd6972966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Flow 'volume_create_manager' (69f761c5-d042-464b-b5de-17981ffee179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:25 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-70193bcd-fc0c-4c03-bdb2-995574158a46 tempest-TaggedAttachmentsTest-1097304134 None] Created volume successfully.
Jun 26 00:22:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-781397a8-ccef-4f3e-af2b-90d272ddd873 req-4f4d828e-489e-4bd4-b2de-f81a1a4bf047 tempest-AttachVolumeShelveTestJSON-884272115 None] No connector for attachment 98ddb2ee-7448-452a-bb5c-2f0e1865cd2e; skipping storage backend terminate_connection call. {{(pid=94563) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 26 00:22:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-781397a8-ccef-4f3e-af2b-90d272ddd873 req-4f4d828e-489e-4bd4-b2de-f81a1a4bf047 tempest-AttachVolumeShelveTestJSON-884272115 None] Deleting attachment 98ddb2ee-7448-452a-bb5c-2f0e1865cd2e. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:22:36 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Flow 'volume_create_manager' (80aa7291-3c24-46fb-82d8-d4b7ac0a6a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81da95ec-5ea8-4f82-b187-f5dbadca924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81da95ec-5ea8-4f82-b187-f5dbadca924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-342038882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b24be22-1109-49a2-ba51-e34d4ffaffaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd2b12ee2a3407f890a54534809d519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:37Z,use_quota=True,user_id='22adaf6b7b5647ee8ae3ce58c7aa870d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa7e446-ec93-4eb0-8961-8c3fa6c14ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa7e446-ec93-4eb0-8961-8c3fa6c14ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bce50c-882f-43d8-a992-592dcb346657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bce50c-882f-43d8-a992-592dcb346657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b24be22-1109-49a2-ba51-e34d4ffaffaf', 'volume_name': 'volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50522f6-4a75-42da-927c-b5d9abbe2bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50522f6-4a75-42da-927c-b5d9abbe2bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a463e5-6d30-457b-9692-566a505cfab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:37 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Volume 9b24be22-1109-49a2-ba51-e34d4ffaffaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf', 'volume_size': 1}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-342038882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b24be22-1109-49a2-ba51-e34d4ffaffaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd2b12ee2a3407f890a54534809d519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:37Z,use_quota=True,user_id='22adaf6b7b5647ee8ae3ce58c7aa870d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Creating volume 9b24be22-1109-49a2-ba51-e34d4ffaffaf {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:37 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:37 devstack sudo[96910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf 1073741824
Jun 26 00:22:37 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:37 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf 1073741824" returned: 0 in 0.896s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:38 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf
Jun 26 00:22:38 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:38 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf" returned: 0 in 0.767s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a463e5-6d30-457b-9692-566a505cfab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a803e-e956-45cc-94ce-ea77aa0104e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Volume volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf (9b24be22-1109-49a2-ba51-e34d4ffaffaf): created successfully
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a803e-e956-45cc-94ce-ea77aa0104e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Flow 'volume_create_manager' (80aa7291-3c24-46fb-82d8-d4b7ac0a6a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:38 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-01ffb848-b7bc-4205-8b92-097a50b6184c tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Created volume successfully.
Jun 26 00:22:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Acquiring lock "cinder-9b24be22-1109-49a2-ba51-e34d4ffaffaf-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:22:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "cinder-9b24be22-1109-49a2-ba51-e34d4ffaffaf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:22:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Acquiring lock "cinder-quobyte-9b24be22-1109-49a2-ba51-e34d4ffaffaf" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:22:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "cinder-quobyte-9b24be22-1109-49a2-ba51-e34d4ffaffaf" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:22:40 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2633b4-d3dd-481a-ac4f-83caa8c660fd]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:22:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:40 devstack sudo[96950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf
Jun 26 00:22:40 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:41 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf" returned: 0 in 0.830s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:41 devstack sudo[96969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf
Jun 26 00:22:41 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:41 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b24be22-1109-49a2-ba51-e34d4ffaffaf" returned: 0 in 0.678s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "cinder-quobyte-9b24be22-1109-49a2-ba51-e34d4ffaffaf" released by "delete_volume" :: held 1.555s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Created reservations ['648e5afb-d126-45bf-ae09-79ece75f0059', '3d5d5117-57d8-44cf-b03e-ed2e1109e91e', '2b4232fb-8545-4de0-b474-d291639a3b14', 'b919beb3-848b-4e80-ab44-66df4d789d87'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:42 devstack sudo[96972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:22:42 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:42 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.696s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:22:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Deleted volume successfully.
Jun 26 00:22:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b5d2b0b5-924e-4d74-8760-345ce40b12e9 tempest-VolumeQuotasNegativeTestJSON-2020698398 None] Lock "cinder-9b24be22-1109-49a2-ba51-e34d4ffaffaf-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Flow 'volume_create_manager' (cb371412-359c-4197-bfcf-ac7e02019c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbfc4ad-0ab7-4308-803b-68b257f2a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbfc4ad-0ab7-4308-803b-68b257f2a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2053648144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ee00d7-e570-42ea-991e-881590c5269e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3409a91e67514c3eb7ec4c7855791724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:50Z,use_quota=True,user_id='0d21b7dc173043b29d744eaef84d8475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced88bc4-02ef-4aba-bbff-edeb2e384f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced88bc4-02ef-4aba-bbff-edeb2e384f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122e66b4-0870-445f-a74b-f67c0b06343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122e66b4-0870-445f-a74b-f67c0b06343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ee00d7-e570-42ea-991e-881590c5269e', 'volume_name': 'volume-d4ee00d7-e570-42ea-991e-881590c5269e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221e9669-1529-4d13-8730-eb60bed7ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221e9669-1529-4d13-8730-eb60bed7ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cb7bca-2b90-42e3-b5fb-c306c8f9d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:50 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Volume d4ee00d7-e570-42ea-991e-881590c5269e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ee00d7-e570-42ea-991e-881590c5269e', 'volume_size': 1}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2053648144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ee00d7-e570-42ea-991e-881590c5269e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3409a91e67514c3eb7ec4c7855791724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:50Z,use_quota=True,user_id='0d21b7dc173043b29d744eaef84d8475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Creating volume d4ee00d7-e570-42ea-991e-881590c5269e {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:50 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:50 devstack sudo[97113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e 1073741824
Jun 26 00:22:50 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Flow 'volume_create_manager' (d02cfe9e-e855-4c53-b653-799cf7b90a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f92bfe7-8fbf-4ec7-8439-6241afeb41e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f92bfe7-8fbf-4ec7-8439-6241afeb41e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1490840813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e7bd8b-6dc5-46af-839c-de76ed2575c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e88179af8b149c686bb2215cd9dd6b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:51Z,use_quota=True,user_id='31c7d741740c42ddac6a5855d1a424c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373cbf0a-7395-4e38-98eb-eeed60a7a6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373cbf0a-7395-4e38-98eb-eeed60a7a6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f6e682-badb-4df0-b93b-ebf75e2d1535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f6e682-badb-4df0-b93b-ebf75e2d1535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e7bd8b-6dc5-46af-839c-de76ed2575c4', 'volume_name': 'volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48879bc-a81f-4795-8ba7-bf973504797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48879bc-a81f-4795-8ba7-bf973504797d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8301ae6c-3e5b-488b-bace-fc04af4d81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:51 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Volume 19e7bd8b-6dc5-46af-839c-de76ed2575c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4', 'volume_size': 1}
Jun 26 00:22:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:52 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e 1073741824" returned: 0 in 2.044s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:52 devstack sudo[97122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e
Jun 26 00:22:52 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:53 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e" returned: 0 in 1.044s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] <== create_volume: return (3160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.164s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1490840813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e7bd8b-6dc5-46af-839c-de76ed2575c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e88179af8b149c686bb2215cd9dd6b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:22:51Z,use_quota=True,user_id='31c7d741740c42ddac6a5855d1a424c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Creating volume 19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:22:53 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:53 devstack sudo[97126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 1073741824
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cb7bca-2b90-42e3-b5fb-c306c8f9d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ee00d7-e570-42ea-991e-881590c5269e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:53 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19598cde-424e-4858-bdee-f0075b66f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:53 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Volume volume-d4ee00d7-e570-42ea-991e-881590c5269e (d4ee00d7-e570-42ea-991e-881590c5269e): created successfully
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19598cde-424e-4858-bdee-f0075b66f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Flow 'volume_create_manager' (cb371412-359c-4197-bfcf-ac7e02019c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-81f6aa0c-4d2f-419c-b888-34cb70ac3d53 tempest-ServerActionsTestOtherA-265097809 None] Created volume successfully.
Jun 26 00:22:54 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 1073741824" returned: 0 in 1.296s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:54 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4
Jun 26 00:22:54 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:55 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4" returned: 0 in 0.826s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8301ae6c-3e5b-488b-bace-fc04af4d81fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6641f58-ab0e-4527-8c0d-a4eac8194ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:22:55 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Volume volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 (19e7bd8b-6dc5-46af-839c-de76ed2575c4): created successfully
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6641f58-ab0e-4527-8c0d-a4eac8194ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:22:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Flow 'volume_create_manager' (d02cfe9e-e855-4c53-b653-799cf7b90a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:22:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0c0b6eef-7702-4e09-954c-e68f66c94b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Created volume successfully.
Jun 26 00:22:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:22:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:22:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Creating offline snapshot 4358e504-eebf-4020-b41f-a0c1e70f72f5 of volume 19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:22:57 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0c5894-1670-454a-b1df-920da4d892e2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:22:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:57 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4
Jun 26 00:22:57 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:58 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4" returned: 0 in 1.281s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:58 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 1G
Jun 26 00:22:58 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:22:59 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Jun 26 00:22:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 1G" returned: 0 in 1.181s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:22:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:22:59 devstack sudo[97248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5
Jun 26 00:22:59 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:00 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5" returned: 0 in 1.168s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:00 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 is being set with open permissions: ugo+rw
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:00 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5
Jun 26 00:23:00 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:01 devstack sudo[97263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:01 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:02 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5" returned: 0 in 1.567s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=32,cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=8 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=33,cinder:UPDATE=49,cinder:INSERT=10,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:02 devstack sudo[97305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info
Jun 26 00:23:02 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:02 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.631s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 8 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:23:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:23:03 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info" returned: 0 in 1.021s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:03 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info is being set with open permissions: ugo+rw
Jun 26 00:23:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:03 devstack sudo[97320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info
Jun 26 00:23:03 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:04 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.info" returned: 0 in 0.725s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.174s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e4cd760a-a1b9-436d-9603-619b146822c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Create snapshot completed successfully
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "cinder-4358e504-eebf-4020-b41f-a0c1e70f72f5-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-4358e504-eebf-4020-b41f-a0c1e70f72f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "cinder-quobyte-19e7bd8b-6dc5-46af-839c-de76ed2575c4" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-quobyte-19e7bd8b-6dc5-46af-839c-de76ed2575c4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "cinder-quobyte-4358e504-eebf-4020-b41f-a0c1e70f72f5" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-quobyte-4358e504-eebf-4020-b41f-a0c1e70f72f5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Deleting offline snapshot 4358e504-eebf-4020-b41f-a0c1e70f72f5 of volume 19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] snapshot_file for this snap is: volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb9bcc8-b8eb-4315-aa5d-3d890d6e28b4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:05 devstack sudo[97325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5
Jun 26 00:23:05 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:05 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5" returned: 0 in 0.878s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:23:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85f8a2-6ee5-4a03-bb1c-216e524d379d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:06 devstack sudo[97330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4
Jun 26 00:23:06 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:06 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4" returned: 0 in 0.778s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:06 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5
Jun 26 00:23:06 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:07 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5" returned: 0 in 0.722s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:07 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5
Jun 26 00:23:07 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:08 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4.4358e504-eebf-4020-b41f-a0c1e70f72f5" returned: 0 in 0.652s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-quobyte-4358e504-eebf-4020-b41f-a0c1e70f72f5" released by "_delete_snapshot" :: held 3.151s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-quobyte-19e7bd8b-6dc5-46af-839c-de76ed2575c4" released by "delete_snapshot" :: held 3.177s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:08 devstack cinder-volume[94563]: WARNING cinder.quota [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:23:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Created reservations ['83abb059-922e-4277-af0f-11afedf5aa3c', '077be95f-60a8-466c-b3a5-0d64f1988a59', '1d36c865-2f92-4a88-bf3d-eb1a41423a4d', 'ff0ff78a-e237-4824-a4ba-59c72a89c84a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Delete snapshot completed successfully.
Jun 26 00:23:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-acc31978-4278-45eb-afa5-19db189500a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-4358e504-eebf-4020-b41f-a0c1e70f72f5-delete_snapshot" released by "delete_snapshot" :: held 3.325s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "cinder-19e7bd8b-6dc5-46af-839c-de76ed2575c4-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-19e7bd8b-6dc5-46af-839c-de76ed2575c4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "cinder-quobyte-19e7bd8b-6dc5-46af-839c-de76ed2575c4" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-quobyte-19e7bd8b-6dc5-46af-839c-de76ed2575c4" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[733d256c-d19e-4abd-b58a-1b872882c620]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:09 devstack sudo[97367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4
Jun 26 00:23:09 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:11 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4" returned: 0 in 1.477s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:11 devstack sudo[97408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4
Jun 26 00:23:11 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:11 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-19e7bd8b-6dc5-46af-839c-de76ed2575c4" returned: 0 in 0.692s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-quobyte-19e7bd8b-6dc5-46af-839c-de76ed2575c4" released by "delete_volume" :: held 2.268s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Created reservations ['670c8db6-e069-429f-948c-f9dae62359a0', 'b145209b-646c-4173-9f45-a04599edf003', 'de0f1173-bf7c-49e2-8510-59e8fa75eb11', 'ed8b5f01-f23b-42a1-bf9a-c7e1de9863c7'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:12 devstack sudo[97413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:12 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:12 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.852s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:12 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Deleted volume successfully.
Jun 26 00:23:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0eb0ae1f-2021-4680-aeb9-24610ec38d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1274541480 None] Lock "cinder-19e7bd8b-6dc5-46af-839c-de76ed2575c4-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Flow 'volume_create_manager' (d596795e-5303-49a4-8f85-1756c3109c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7935a3-d73c-4b3e-a41c-d1a05d3c6238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7935a3-d73c-4b3e-a41c-d1a05d3c6238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-501946181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8138c887-92bb-4614-be44-5e29adfe3fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a006ec017e44b85bbd5546e4d5583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:20Z,use_quota=True,user_id='6e18932183c7430a8687b32475465f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496dc662-522e-4987-b182-42b4090a9e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496dc662-522e-4987-b182-42b4090a9e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0aae6a-dfb8-41f6-a880-596fb06b80ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0aae6a-dfb8-41f6-a880-596fb06b80ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8138c887-92bb-4614-be44-5e29adfe3fcf', 'volume_name': 'volume-8138c887-92bb-4614-be44-5e29adfe3fcf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65a3a65-1fa0-4dc3-a0c0-d3dcfd66d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65a3a65-1fa0-4dc3-a0c0-d3dcfd66d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c7be28-70cd-4b2c-9bcb-9a56d5aaffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:20 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Volume 8138c887-92bb-4614-be44-5e29adfe3fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8138c887-92bb-4614-be44-5e29adfe3fcf', 'volume_size': 1}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-501946181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8138c887-92bb-4614-be44-5e29adfe3fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a006ec017e44b85bbd5546e4d5583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:20Z,use_quota=True,user_id='6e18932183c7430a8687b32475465f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Creating volume 8138c887-92bb-4614-be44-5e29adfe3fcf {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:23:20 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:23:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:20 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf 1073741824
Jun 26 00:23:20 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:21 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf 1073741824" returned: 0 in 0.848s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:21 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf
Jun 26 00:23:21 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:21 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf" returned: 0 in 0.648s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c7be28-70cd-4b2c-9bcb-9a56d5aaffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8138c887-92bb-4614-be44-5e29adfe3fcf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7722015-15f2-4253-afcb-b6096e128d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:21 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Volume volume-8138c887-92bb-4614-be44-5e29adfe3fcf (8138c887-92bb-4614-be44-5e29adfe3fcf): created successfully
Jun 26 00:23:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7722015-15f2-4253-afcb-b6096e128d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Flow 'volume_create_manager' (d596795e-5303-49a4-8f85-1756c3109c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-114f4aff-72fc-485c-a16f-f235904db1d8 tempest-VolumesListAdminTestJSON-819164464 None] Created volume successfully.
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Flow 'volume_create_manager' (62a66c41-0844-4e6f-b117-56691beb034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3a5444-f6cd-4cf8-93e4-1b889dae474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3a5444-f6cd-4cf8-93e4-1b889dae474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1054251444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd63775-d66b-4521-a371-5b434aa73c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a006ec017e44b85bbd5546e4d5583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:23Z,use_quota=True,user_id='6e18932183c7430a8687b32475465f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ea64e9-2c1e-4250-8f48-78b0511069fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ea64e9-2c1e-4250-8f48-78b0511069fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c56dc7-129d-4203-b6a1-6aa399a3fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c56dc7-129d-4203-b6a1-6aa399a3fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd63775-d66b-4521-a371-5b434aa73c35', 'volume_name': 'volume-9cd63775-d66b-4521-a371-5b434aa73c35', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88da6b23-7437-46ad-a116-ed2f983ef7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88da6b23-7437-46ad-a116-ed2f983ef7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf11741-6c92-4682-8ad5-d18b76d812d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:23 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Volume 9cd63775-d66b-4521-a371-5b434aa73c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd63775-d66b-4521-a371-5b434aa73c35', 'volume_size': 1}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1054251444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd63775-d66b-4521-a371-5b434aa73c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a006ec017e44b85bbd5546e4d5583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:23Z,use_quota=True,user_id='6e18932183c7430a8687b32475465f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Creating volume 9cd63775-d66b-4521-a371-5b434aa73c35 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:23:23 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:23:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:23 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35 1073741824
Jun 26 00:23:23 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:24 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35 1073741824" returned: 0 in 1.741s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:24 devstack sudo[97537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35
Jun 26 00:23:24 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:25 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35" returned: 0 in 0.711s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] <== create_volume: return (2497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.499s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf11741-6c92-4682-8ad5-d18b76d812d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd63775-d66b-4521-a371-5b434aa73c35', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b9c1c3-5504-4b82-b904-4008a4606ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:25 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Volume volume-9cd63775-d66b-4521-a371-5b434aa73c35 (9cd63775-d66b-4521-a371-5b434aa73c35): created successfully
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b9c1c3-5504-4b82-b904-4008a4606ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Flow 'volume_create_manager' (62a66c41-0844-4e6f-b117-56691beb034a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:25 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-df57f0b9-92f4-49a9-b882-fe19846aa10d tempest-VolumesListAdminTestJSON-819164464 None] Created volume successfully.
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Flow 'volume_create_manager' (0e62903c-2b06-49c7-89fa-984d42e0a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7eba57-cbd6-4290-b0b0-edcd0a12573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7eba57-cbd6-4290-b0b0-edcd0a12573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1115784865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaea592a-7aab-4c87-a80e-6043efc0c6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a006ec017e44b85bbd5546e4d5583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:27Z,use_quota=True,user_id='6e18932183c7430a8687b32475465f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087d9935-fb20-40a3-af0f-3bc229eeb5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087d9935-fb20-40a3-af0f-3bc229eeb5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a0068e-ae78-469b-ad18-dedba690696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a0068e-ae78-469b-ad18-dedba690696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaea592a-7aab-4c87-a80e-6043efc0c6c1', 'volume_name': 'volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e383b994-0fcc-4667-975f-415ababb720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e383b994-0fcc-4667-975f-415ababb720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1679762-3e93-4c0a-b261-73005ab3dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Volume eaea592a-7aab-4c87-a80e-6043efc0c6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1', 'volume_size': 1}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1115784865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaea592a-7aab-4c87-a80e-6043efc0c6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a006ec017e44b85bbd5546e4d5583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:27Z,use_quota=True,user_id='6e18932183c7430a8687b32475465f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Creating volume eaea592a-7aab-4c87-a80e-6043efc0c6c1 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:23:26 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:23:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:26 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 1073741824
Jun 26 00:23:26 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:27 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 1073741824" returned: 0 in 0.838s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:27 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1
Jun 26 00:23:27 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:28 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1" returned: 0 in 0.608s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1679762-3e93-4c0a-b261-73005ab3dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae9786-049d-4c15-8772-accdff67b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:28 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Volume volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 (eaea592a-7aab-4c87-a80e-6043efc0c6c1): created successfully
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae9786-049d-4c15-8772-accdff67b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Flow 'volume_create_manager' (0e62903c-2b06-49c7-89fa-984d42e0a026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:28 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-aeaec1f8-92da-41e9-bbed-80df96177d48 tempest-VolumesListAdminTestJSON-819164464 None] Created volume successfully.
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Flow 'volume_create_manager' (f6cae411-59fc-4a89-a504-aba928cfdba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089a5edf-54da-430c-a813-7a28d88b766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089a5edf-54da-430c-a813-7a28d88b766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06018458-5a8f-4460-b94b-a3665f22a362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb72b444018b4e1faa5eb9f68a7f9c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:29Z,use_quota=True,user_id='23bcc5a86a2d48c6ad0880538db2c914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef8ec9b-ad1c-4bfb-bb40-ba7c3c63b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef8ec9b-ad1c-4bfb-bb40-ba7c3c63b674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa6fa14-b84d-4806-8552-9ccdbcab4509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa6fa14-b84d-4806-8552-9ccdbcab4509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06018458-5a8f-4460-b94b-a3665f22a362', 'volume_name': 'volume-06018458-5a8f-4460-b94b-a3665f22a362', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfb6145-9a81-43e6-956c-949ab8cbb898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfb6145-9a81-43e6-956c-949ab8cbb898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e79da1-9583-436b-a7d8-08c8af223288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:29 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Volume 06018458-5a8f-4460-b94b-a3665f22a362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06018458-5a8f-4460-b94b-a3665f22a362', 'volume_size': 1}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06018458-5a8f-4460-b94b-a3665f22a362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb72b444018b4e1faa5eb9f68a7f9c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:29Z,use_quota=True,user_id='23bcc5a86a2d48c6ad0880538db2c914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Creating volume 06018458-5a8f-4460-b94b-a3665f22a362 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:23:29 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:23:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:29 devstack sudo[97570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362 1073741824
Jun 26 00:23:29 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:30 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362 1073741824" returned: 0 in 0.853s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:30 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362
Jun 26 00:23:30 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:31 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362" returned: 0 in 0.649s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.982s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e79da1-9583-436b-a7d8-08c8af223288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06018458-5a8f-4460-b94b-a3665f22a362', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b54a0cf-775a-424a-91ab-09347d24bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d92096-2247-412a-bda7-471136c1eb79]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:31 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Volume volume-06018458-5a8f-4460-b94b-a3665f22a362 (06018458-5a8f-4460-b94b-a3665f22a362): created successfully
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b54a0cf-775a-424a-91ab-09347d24bc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Flow 'volume_create_manager' (f6cae411-59fc-4a89-a504-aba928cfdba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:31 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3b012e87-8b54-4405-b83d-2dba8fe8c350 tempest-VolumesListAdminTestJSON-212394770 None] Created volume successfully.
Jun 26 00:23:31 devstack sudo[97586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0
Jun 26 00:23:31 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Acquiring lock "cinder-06018458-5a8f-4460-b94b-a3665f22a362-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Lock "cinder-06018458-5a8f-4460-b94b-a3665f22a362-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Acquiring lock "cinder-quobyte-06018458-5a8f-4460-b94b-a3665f22a362" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Lock "cinder-quobyte-06018458-5a8f-4460-b94b-a3665f22a362" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e24d3d-5f22-432e-8317-b98c956e6f5a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "cinder-eaea592a-7aab-4c87-a80e-6043efc0c6c1-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-eaea592a-7aab-4c87-a80e-6043efc0c6c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:31 devstack sudo[97588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362
Jun 26 00:23:31 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "cinder-quobyte-eaea592a-7aab-4c87-a80e-6043efc0c6c1" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-quobyte-eaea592a-7aab-4c87-a80e-6043efc0c6c1" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[18204410-3c00-4806-bcea-90f8c7943a0c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:31 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0" returned: 0 in 0.867s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-2e489a4f-7080-4031-9dfe-864c9a4992d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5c5ded3-1fe3-49ce-a93e-2aaaae95a4ff', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:23:32 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1
Jun 26 00:23:32 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-32c2b070-4812-4a89-bbdb-905fa1284f8d req-27984453-1b6b-4b5f-b289-a46368972206 tempest-TaggedAttachmentsTest-1097304134 None] attachment_update completed successfully.
Jun 26 00:23:32 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362" returned: 0 in 0.893s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:32 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362
Jun 26 00:23:32 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:32 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1" returned: 0 in 0.967s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:32 devstack sudo[97671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1
Jun 26 00:23:32 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:33 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06018458-5a8f-4460-b94b-a3665f22a362" returned: 0 in 0.853s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Lock "cinder-quobyte-06018458-5a8f-4460-b94b-a3665f22a362" released by "delete_volume" :: held 1.801s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Created reservations ['db9494ab-94db-4dd2-a77f-10a49ed8c075', '1a690c69-cfc1-4a04-886d-7aeda1e8c011', 'ceb93cf0-9f45-4e82-9bc2-b2430244e885', '419471a4-c6ec-404e-b1cb-0429f337b70f'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:33 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:33 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:33 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eaea592a-7aab-4c87-a80e-6043efc0c6c1" returned: 0 in 0.813s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-quobyte-eaea592a-7aab-4c87-a80e-6043efc0c6c1" released by "delete_volume" :: held 1.837s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Created reservations ['74ee56b4-e826-4b61-a6e2-3bf43f6a98d1', '5caee9bd-e406-4d60-a444-56659668a972', '318d3699-9415-4f11-8c9d-0e586401c8e4', 'fa75806d-66a8-4812-8e8e-a4da9daed11b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:33 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:33 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "cinder-9cd63775-d66b-4521-a371-5b434aa73c35-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-9cd63775-d66b-4521-a371-5b434aa73c35-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:34 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.737s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "cinder-quobyte-9cd63775-d66b-4521-a371-5b434aa73c35" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Deleted volume successfully.
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-quobyte-9cd63775-d66b-4521-a371-5b434aa73c35" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b167da34-67dc-4755-81b9-43566d0100c0 tempest-VolumesListAdminTestJSON-212394770 None] Lock "cinder-06018458-5a8f-4460-b94b-a3665f22a362-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9c778-21a5-4e31-b156-d6b6bc14a6b1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:34 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35
Jun 26 00:23:34 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:34 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.793s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Deleted volume successfully.
Jun 26 00:23:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a40420d6-4dc9-4d7f-bb9f-a73d5409f5d1 tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-eaea592a-7aab-4c87-a80e-6043efc0c6c1-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:35 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35" returned: 0 in 0.784s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:35 devstack sudo[98009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35
Jun 26 00:23:35 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:35 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9cd63775-d66b-4521-a371-5b434aa73c35" returned: 0 in 0.655s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-quobyte-9cd63775-d66b-4521-a371-5b434aa73c35" released by "delete_volume" :: held 1.481s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:35 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Created reservations ['2c9c42b0-1946-44fc-a31b-03e8f385ac40', 'a71bed79-1b3d-4663-a825-05ca2437f554', '1fbdb3d5-52c5-40b9-9666-ae0823cb504c', '84c073b3-d130-4bcd-9d43-14a8afc668b1'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:36 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:36 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "cinder-8138c887-92bb-4614-be44-5e29adfe3fcf-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-8138c887-92bb-4614-be44-5e29adfe3fcf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:36 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.691s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Deleted volume successfully.
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "cinder-quobyte-8138c887-92bb-4614-be44-5e29adfe3fcf" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c2f10044-f4ad-45a3-a32c-5db18c76d02d tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-9cd63775-d66b-4521-a371-5b434aa73c35-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-quobyte-8138c887-92bb-4614-be44-5e29adfe3fcf" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[577bcaa6-63c0-451c-8095-438d4fbc9bdf]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:36 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf
Jun 26 00:23:36 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:37 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf" returned: 0 in 0.793s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:37 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf
Jun 26 00:23:37 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:38 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8138c887-92bb-4614-be44-5e29adfe3fcf" returned: 0 in 0.766s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-quobyte-8138c887-92bb-4614-be44-5e29adfe3fcf" released by "delete_volume" :: held 1.606s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Created reservations ['870df316-8724-4ac7-8506-aed01ede2b92', 'b9dceaa7-4b2f-4a7f-a52f-e2f7c125b69e', 'c6699855-2518-43db-8598-b93e6f16fe99', '4c1307bf-cfb5-468c-8ee7-fb609aa97826'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:38 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-8ee45a63-2e14-4cc9-94cd-2256733dfcbf req-6b1bceed-6e4f-46ba-8b4e-bd26a1ff2461 tempest-TaggedAttachmentsTest-1097304134 None] Terminate volume connection completed successfully.
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-8ee45a63-2e14-4cc9-94cd-2256733dfcbf req-6b1bceed-6e4f-46ba-8b4e-bd26a1ff2461 tempest-TaggedAttachmentsTest-1097304134 None] Deleting attachment b5c5ded3-1fe3-49ce-a93e-2aaaae95a4ff. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:38 devstack sudo[98068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:38 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4e00f-93b1-4568-abf6-50a2cbcb2f12]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:39 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e
Jun 26 00:23:39 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:39 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.190s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Deleted volume successfully.
Jun 26 00:23:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a097a4bd-c7ae-42d9-ad0b-9b2d1f0a486c tempest-VolumesListAdminTestJSON-819164464 None] Lock "cinder-8138c887-92bb-4614-be44-5e29adfe3fcf-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:40 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e" returned: 0 in 1.250s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.273s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-d4ee00d7-e570-42ea-991e-881590c5269e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '388389be-9118-4785-adff-33b6e96681ca', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:23:40 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-12681c46-8501-4996-9245-7dfcaeebcf1d req-337e796f-9546-42fe-b715-bb94c2da516f tempest-ServerActionsTestOtherA-265097809 None] attachment_update completed successfully.
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Flow 'volume_create_manager' (6975e43e-1d20-45f6-aab5-9d3c90661eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba734ec-56a9-48f5-8811-e0b4a75821d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba734ec-56a9-48f5-8811-e0b4a75821d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-853794473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85be1a5-191a-45f6-8b8f-d824ab925f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c49cd4ea8794150afecc636adebc842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:46Z,use_quota=True,user_id='9ae67437d7df4dfdbdd5b038fa3e8f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cd0eeb-a3d2-4ddb-9d9d-64cbc6114a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cd0eeb-a3d2-4ddb-9d9d-64cbc6114a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660e1bf5-a397-4c83-9337-0fda76b57765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660e1bf5-a397-4c83-9337-0fda76b57765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85be1a5-191a-45f6-8b8f-d824ab925f0e', 'volume_name': 'volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11596f12-8185-4f62-b842-ac24983dcbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11596f12-8185-4f62-b842-ac24983dcbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0afe2e-6534-4bf0-a6e7-fda61d2727f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:46 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Volume d85be1a5-191a-45f6-8b8f-d824ab925f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e', 'volume_size': 1}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-853794473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85be1a5-191a-45f6-8b8f-d824ab925f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c49cd4ea8794150afecc636adebc842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:23:46Z,use_quota=True,user_id='9ae67437d7df4dfdbdd5b038fa3e8f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Creating volume d85be1a5-191a-45f6-8b8f-d824ab925f0e {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:23:46 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:23:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:46 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e 1073741824
Jun 26 00:23:46 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:47 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e 1073741824" returned: 0 in 1.285s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:47 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e
Jun 26 00:23:47 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Acquiring lock "cinder-032218e7-78e3-4365-bf16-cb130dd3d0b7-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "cinder-032218e7-78e3-4365-bf16-cb130dd3d0b7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Acquiring lock "cinder-quobyte-032218e7-78e3-4365-bf16-cb130dd3d0b7" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "cinder-quobyte-032218e7-78e3-4365-bf16-cb130dd3d0b7" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a2647f-9ae8-4ac3-93ad-7a62f9ca51fc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:47 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7
Jun 26 00:23:47 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:48 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e" returned: 0 in 0.791s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0afe2e-6534-4bf0-a6e7-fda61d2727f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af62454-111e-462e-9dbb-d430ac9a83d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:23:48 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Volume volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e (d85be1a5-191a-45f6-8b8f-d824ab925f0e): created successfully
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af62454-111e-462e-9dbb-d430ac9a83d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Flow 'volume_create_manager' (6975e43e-1d20-45f6-aab5-9d3c90661eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:23:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9f5d0338-e373-40d3-af24-7e7892acf60b tempest-AbsoluteLimitsTests-962503638 None] Created volume successfully.
Jun 26 00:23:48 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7" returned: 0 in 0.966s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:48 devstack sudo[98642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7
Jun 26 00:23:48 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Acquiring lock "cinder-d85be1a5-191a-45f6-8b8f-d824ab925f0e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Lock "cinder-d85be1a5-191a-45f6-8b8f-d824ab925f0e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Acquiring lock "cinder-quobyte-d85be1a5-191a-45f6-8b8f-d824ab925f0e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Lock "cinder-quobyte-d85be1a5-191a-45f6-8b8f-d824ab925f0e" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c11e71-e0c2-4564-9742-1ae1607e68a3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:49 devstack sudo[98690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e
Jun 26 00:23:49 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-9db81714-f85b-4709-9e99-08c8526ad7bf tempest-ServerActionsTestOtherA-265097809 None] Terminate volume connection completed successfully.
Jun 26 00:23:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-9db81714-f85b-4709-9e99-08c8526ad7bf tempest-ServerActionsTestOtherA-265097809 None] Deleting attachment 388389be-9118-4785-adff-33b6e96681ca. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:23:50 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-032218e7-78e3-4365-bf16-cb130dd3d0b7" returned: 0 in 1.210s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "cinder-quobyte-032218e7-78e3-4365-bf16-cb130dd3d0b7" released by "delete_volume" :: held 2.220s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Created reservations ['b0f0d783-975a-455b-8819-39e071cc11d1', 'd5572f48-f5e9-4ace-80e5-3e8fccba991f', '9f7ecde4-2733-4cd6-8310-f582792064c4', 'b7c4253f-dea0-4866-984c-299c405bcc27'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:50 devstack sudo[98725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:50 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:50 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e" returned: 0 in 1.128s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:50 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e
Jun 26 00:23:50 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:51 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.881s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Deleted volume successfully.
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e280d5b7-9ac8-4e9b-b4c7-bec57ddf6e78 tempest-AttachVolumeShelveTestJSON-884272115 None] Lock "cinder-032218e7-78e3-4365-bf16-cb130dd3d0b7-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:51 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d85be1a5-191a-45f6-8b8f-d824ab925f0e" returned: 0 in 0.934s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Lock "cinder-quobyte-d85be1a5-191a-45f6-8b8f-d824ab925f0e" released by "delete_volume" :: held 2.131s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Created reservations ['4696524a-1538-412e-8f28-ecde8715a288', '71ec548d-1dfc-44cc-97d0-06cb7e8259e4', '17b282c7-40c2-433a-a7a0-9ebd357b2f1a', 'a90dff62-4b0d-4055-90a3-ca1fa00186c8'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:51 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:23:51 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e81843-31b9-4a85-afab-f66d3da16b08]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:52 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e
Jun 26 00:23:52 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:52 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.720s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:23:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Deleted volume successfully.
Jun 26 00:23:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e48dacca-78d6-4a59-a3af-e46cf834bb10 tempest-AbsoluteLimitsTests-962503638 None] Lock "cinder-d85be1a5-191a-45f6-8b8f-d824ab925f0e-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:23:53 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e" returned: 0 in 0.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:23:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-d4ee00d7-e570-42ea-991e-881590c5269e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fafd086-2d91-48a7-8e3d-7f2818b70423', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:23:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-f089d66d-13bb-45c2-abab-cff5da1ffcce req-7c857cf9-f89f-4736-9471-781bc126b9ea tempest-ServerActionsTestOtherA-265097809 None] attachment_update completed successfully.
Jun 26 00:23:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Acquiring lock "cinder-2e489a4f-7080-4031-9dfe-864c9a4992d0-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Lock "cinder-2e489a4f-7080-4031-9dfe-864c9a4992d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Acquiring lock "cinder-quobyte-2e489a4f-7080-4031-9dfe-864c9a4992d0" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:23:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Lock "cinder-quobyte-2e489a4f-7080-4031-9dfe-864c9a4992d0" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:23:58 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac4bcc4-24e6-483e-b547-af1b5911da6d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:23:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:58 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0
Jun 26 00:23:58 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:23:59 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Jun 26 00:23:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0" returned: 0 in 0.947s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:23:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:23:59 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0
Jun 26 00:23:59 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:24:00 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Flow 'volume_create_manager' (f3748b42-5980-4f77-8976-d3b6920ed980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfddac03-73eb-4d04-aba5-3dab7f4b1e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2e489a4f-7080-4031-9dfe-864c9a4992d0" returned: 0 in 1.107s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Lock "cinder-quobyte-2e489a4f-7080-4031-9dfe-864c9a4992d0" released by "delete_volume" :: held 2.143s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfddac03-73eb-4d04-aba5-3dab7f4b1e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-887449520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dd62ff-571f-4249-b264-a77a9bcc162c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a86389d24c4a1a992fcdab3f1381a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:01Z,use_quota=True,user_id='47d5bbf342834106ba4d1cfbcd7d5508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52129bf6-171a-443b-bffc-9ba2891c4f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52129bf6-171a-443b-bffc-9ba2891c4f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631896d3-2520-4cb6-8151-62391a66af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631896d3-2520-4cb6-8151-62391a66af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67dd62ff-571f-4249-b264-a77a9bcc162c', 'volume_name': 'volume-67dd62ff-571f-4249-b264-a77a9bcc162c', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38a48c2-fe82-4aaf-9405-4d723f34c5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38a48c2-fe82-4aaf-9405-4d723f34c5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d35177-6859-449f-a4bf-17b2d3c6e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Volume 67dd62ff-571f-4249-b264-a77a9bcc162c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67dd62ff-571f-4249-b264-a77a9bcc162c', 'volume_size': 1}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-887449520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dd62ff-571f-4249-b264-a77a9bcc162c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a86389d24c4a1a992fcdab3f1381a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:01Z,use_quota=True,user_id='47d5bbf342834106ba4d1cfbcd7d5508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Creating volume 67dd62ff-571f-4249-b264-a77a9bcc162c {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:24:00 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:00 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c 1073741824
Jun 26 00:24:00 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Created reservations ['eeb64e3d-f8b7-4333-872b-7f514a3e2f65', '9ddf5fbf-9a23-4395-9a34-2d338b88aa05', '79781fb1-8e60-4ec6-a1ad-fedcb93cda65', '7c8123ad-b02c-4d98-96b0-c4aa9298a4c5'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:01 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:01 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:01 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:01 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:02 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c 1073741824" returned: 0 in 1.477s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:02 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.461s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 8 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:24:02 devstack sudo[99251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c
Jun 26 00:24:02 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.365s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:02 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Deleted volume successfully.
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=75,cinder:UPDATE=91,cinder:INSERT=20,cinder:DELETE=12 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:24:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d184ebd1-fec5-4977-aa5c-4cf8134c7e1e tempest-TaggedAttachmentsTest-1097304134 None] Lock "cinder-2e489a4f-7080-4031-9dfe-864c9a4992d0-delete_volume" released by "delete_volume" :: held 4.057s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:03 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c" returned: 0 in 1.042s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=81,cinder:UPDATE=94,cinder:INSERT=23,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d35177-6859-449f-a4bf-17b2d3c6e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67dd62ff-571f-4249-b264-a77a9bcc162c', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e80936-9017-4e1d-bc3c-51ad7419d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Volume volume-67dd62ff-571f-4249-b264-a77a9bcc162c (67dd62ff-571f-4249-b264-a77a9bcc162c): created successfully
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e80936-9017-4e1d-bc3c-51ad7419d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Flow 'volume_create_manager' (f3748b42-5980-4f77-8976-d3b6920ed980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1e317f51-bbbf-4756-a5ba-dfee47181879 tempest-VolumesTransfersV355Test-2009829703 None] Created volume successfully.
Jun 26 00:24:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-426e3dd8-663b-42b7-98e4-ad66aa29ff2f tempest-VolumesTransfersV355Test-172297310 None] Transfer volume completed successfully.
Jun 26 00:24:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Acquiring lock "cinder-67dd62ff-571f-4249-b264-a77a9bcc162c-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-67dd62ff-571f-4249-b264-a77a9bcc162c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Acquiring lock "cinder-quobyte-67dd62ff-571f-4249-b264-a77a9bcc162c" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-quobyte-67dd62ff-571f-4249-b264-a77a9bcc162c" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b420d08-6f7f-41b2-9fea-f87e7041f597]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:24:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:06 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c
Jun 26 00:24:06 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:07 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c" returned: 0 in 1.480s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:07 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c
Jun 26 00:24:07 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:08 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67dd62ff-571f-4249-b264-a77a9bcc162c" returned: 0 in 1.081s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-quobyte-67dd62ff-571f-4249-b264-a77a9bcc162c" released by "delete_volume" :: held 2.656s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Created reservations ['04581b53-6fbe-4c7e-814a-e7155f9af532', '3ea1aafa-f07b-47e7-8147-68cdf2611a38', '61c881fb-71bd-4cea-b166-838cff7ed5f4', '4d6937ea-baa1-4684-8c73-f8e58c235ac0'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:08 devstack sudo[99267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:08 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:09 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.055s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:09 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:09 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Deleted volume successfully.
Jun 26 00:24:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ada759f3-14f3-4417-a57d-b1db4ce6b448 tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-67dd62ff-571f-4249-b264-a77a9bcc162c-delete_volume" released by "delete_volume" :: held 4.191s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Flow 'volume_create_manager' (f47b1a9b-16ac-483a-a132-264b2645c57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe42c2f-c853-4395-b8a0-4660ccee14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe42c2f-c853-4395-b8a0-4660ccee14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-882643282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce81bad-b4e5-4cc3-9b39-e010886ec06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a86389d24c4a1a992fcdab3f1381a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:10Z,use_quota=True,user_id='47d5bbf342834106ba4d1cfbcd7d5508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2332d4cb-d453-4ca1-82be-8e23c6e218e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2332d4cb-d453-4ca1-82be-8e23c6e218e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b030b89-e990-49b8-8cec-cc7e6ad7149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b030b89-e990-49b8-8cec-cc7e6ad7149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce81bad-b4e5-4cc3-9b39-e010886ec06f', 'volume_name': 'volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716fc44f-8c6b-4943-8c5f-35bca067ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716fc44f-8c6b-4943-8c5f-35bca067ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c1dc31-5afb-4d44-b624-e3bf1076e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:10 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Volume 4ce81bad-b4e5-4cc3-9b39-e010886ec06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f', 'volume_size': 1}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-882643282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce81bad-b4e5-4cc3-9b39-e010886ec06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a86389d24c4a1a992fcdab3f1381a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:10Z,use_quota=True,user_id='47d5bbf342834106ba4d1cfbcd7d5508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Creating volume 4ce81bad-b4e5-4cc3-9b39-e010886ec06f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:24:10 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:24:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:10 devstack sudo[99271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f 1073741824
Jun 26 00:24:10 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:12 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f 1073741824" returned: 0 in 1.587s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:12 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f
Jun 26 00:24:12 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:12 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f" returned: 0 in 0.823s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] <== create_volume: return (2488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:24:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c1dc31-5afb-4d44-b624-e3bf1076e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2221129-5f0a-4243-b909-5b614212f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:13 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Volume volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f (4ce81bad-b4e5-4cc3-9b39-e010886ec06f): created successfully
Jun 26 00:24:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2221129-5f0a-4243-b909-5b614212f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Flow 'volume_create_manager' (f47b1a9b-16ac-483a-a132-264b2645c57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d408fea7-6a6f-4537-b3d8-daf51b3af030 tempest-VolumesTransfersV355Test-2009829703 None] Created volume successfully.
Jun 26 00:24:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Acquiring lock "cinder-4ce81bad-b4e5-4cc3-9b39-e010886ec06f-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-4ce81bad-b4e5-4cc3-9b39-e010886ec06f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Acquiring lock "cinder-quobyte-4ce81bad-b4e5-4cc3-9b39-e010886ec06f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-quobyte-4ce81bad-b4e5-4cc3-9b39-e010886ec06f" acquired by "delete_volume" :: waited 0.034s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:14 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d53ba1-f452-4974-94ae-d417574e1bdd]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:24:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:14 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f
Jun 26 00:24:14 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:15 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f" returned: 0 in 1.268s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:15 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f
Jun 26 00:24:15 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:16 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ce81bad-b4e5-4cc3-9b39-e010886ec06f" returned: 0 in 0.784s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-quobyte-4ce81bad-b4e5-4cc3-9b39-e010886ec06f" released by "delete_volume" :: held 2.112s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Created reservations ['c43feb2d-67cc-441b-ab80-5378c6e2e54e', 'eaa2b891-af60-4341-a45c-4128e08656f5', 'd7cd9cda-8aae-4427-9cb4-20582bfc4170', 'eda0f6b9-a465-4c14-8e72-09c3a94acb89'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:16 devstack sudo[99321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:16 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:17 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.738s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:17 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Deleted volume successfully.
Jun 26 00:24:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6a60fde8-9217-4b52-badc-30b04a459cee tempest-VolumesTransfersV355Test-1699816004 None] Lock "cinder-4ce81bad-b4e5-4cc3-9b39-e010886ec06f-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=25,cinder:SELECT=10,cinder:INSERT=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Flow 'volume_create_manager' (d8efc7db-9195-4142-a53f-1d82e1605fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b04196-aff0-46ac-8944-a46722329caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b04196-aff0-46ac-8944-a46722329caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1916603122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99374db-c09a-452e-b419-2380af1ee45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9e7f9289874d03b9f049617611bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:26Z,use_quota=True,user_id='05b65a28ba30499f8ed053bb7aad0953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d6ca50-77cf-4cea-a8f8-102eb6a5013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d6ca50-77cf-4cea-a8f8-102eb6a5013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e43ccf-4ca8-4ca9-a23f-41eb13653796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e43ccf-4ca8-4ca9-a23f-41eb13653796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99374db-c09a-452e-b419-2380af1ee45f', 'volume_name': 'volume-f99374db-c09a-452e-b419-2380af1ee45f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71cd272-4252-4f2b-89d0-2d2ecefce7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71cd272-4252-4f2b-89d0-2d2ecefce7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bef256-ab84-4320-94fe-730e821c4656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Volume f99374db-c09a-452e-b419-2380af1ee45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99374db-c09a-452e-b419-2380af1ee45f', 'volume_size': 1}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1916603122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99374db-c09a-452e-b419-2380af1ee45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9e7f9289874d03b9f049617611bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:26Z,use_quota=True,user_id='05b65a28ba30499f8ed053bb7aad0953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Creating volume f99374db-c09a-452e-b419-2380af1ee45f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:24:26 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:24:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:26 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f 1073741824
Jun 26 00:24:26 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:27 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f 1073741824" returned: 0 in 0.847s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:27 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f
Jun 26 00:24:27 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:28 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f" returned: 0 in 0.743s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bef256-ab84-4320-94fe-730e821c4656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99374db-c09a-452e-b419-2380af1ee45f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ff575f-fc26-4a73-ba42-085c6d65b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:28 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Volume volume-f99374db-c09a-452e-b419-2380af1ee45f (f99374db-c09a-452e-b419-2380af1ee45f): created successfully
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ff575f-fc26-4a73-ba42-085c6d65b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Flow 'volume_create_manager' (d8efc7db-9195-4142-a53f-1d82e1605fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:28 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7a70e206-9aff-44b2-a857-fe5ca99d88e1 tempest-VolumesTransfersV357Test-149110942 None] Created volume successfully.
Jun 26 00:24:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6efb7431-0e74-437e-81da-29f222495fb6 tempest-VolumesTransfersV357Test-845615145 None] Transfer volume completed successfully.
Jun 26 00:24:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-d942028a-4116-4c72-8826-2ddab7caafd3 req-878af353-f1f6-47a0-aeec-29d2166942eb tempest-ServerActionsTestOtherA-265097809 None] Terminate volume connection completed successfully.
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-d942028a-4116-4c72-8826-2ddab7caafd3 req-878af353-f1f6-47a0-aeec-29d2166942eb tempest-ServerActionsTestOtherA-265097809 None] Deleting attachment 7fafd086-2d91-48a7-8e3d-7f2818b70423. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Acquiring lock "cinder-f99374db-c09a-452e-b419-2380af1ee45f-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-f99374db-c09a-452e-b419-2380af1ee45f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Acquiring lock "cinder-quobyte-f99374db-c09a-452e-b419-2380af1ee45f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-quobyte-f99374db-c09a-452e-b419-2380af1ee45f" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b495548-ee31-4d0a-accb-34519fb410eb]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:24:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:30 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f
Jun 26 00:24:30 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:32 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f" returned: 0 in 1.631s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:32 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f
Jun 26 00:24:32 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:33 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f99374db-c09a-452e-b419-2380af1ee45f" returned: 0 in 0.909s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-quobyte-f99374db-c09a-452e-b419-2380af1ee45f" released by "delete_volume" :: held 2.608s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Created reservations ['49aa55a3-00ff-43aa-8413-31e93147e564', 'fa84d95c-57b1-4024-b4ec-4d13ab82fb12', '06b9b752-e8d2-4af3-8c01-53be6b093ae3', '922fbdd0-b8a1-4914-a054-e7b8953c4534'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:33 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:33 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:35 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.834s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:35 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Deleted volume successfully.
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Flow 'volume_create_manager' (22cc46ab-e4bb-4fbb-9141-90312d6673e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27525811-5e11-43bc-8fcc-f05534e2df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-337af2b2-d99d-404c-9d4e-75a1ca22455d tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-f99374db-c09a-452e-b419-2380af1ee45f-delete_volume" released by "delete_volume" :: held 5.044s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27525811-5e11-43bc-8fcc-f05534e2df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-950311014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2958d3c-4cd9-436e-90b2-df55cf7df270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9e7f9289874d03b9f049617611bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:36Z,use_quota=True,user_id='05b65a28ba30499f8ed053bb7aad0953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86405812-f689-403e-99b0-45d65df64dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86405812-f689-403e-99b0-45d65df64dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684339bb-b173-484d-b96c-efc90389b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684339bb-b173-484d-b96c-efc90389b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2958d3c-4cd9-436e-90b2-df55cf7df270', 'volume_name': 'volume-f2958d3c-4cd9-436e-90b2-df55cf7df270', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3d0d4e-f50c-45fb-9a9a-7df97577d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3d0d4e-f50c-45fb-9a9a-7df97577d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0857ee-ba47-441d-8827-074858e16b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:35 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Volume f2958d3c-4cd9-436e-90b2-df55cf7df270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2958d3c-4cd9-436e-90b2-df55cf7df270', 'volume_size': 1}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-950311014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2958d3c-4cd9-436e-90b2-df55cf7df270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9e7f9289874d03b9f049617611bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:36Z,use_quota=True,user_id='05b65a28ba30499f8ed053bb7aad0953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Creating volume f2958d3c-4cd9-436e-90b2-df55cf7df270 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:24:35 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:24:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:35 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 1073741824
Jun 26 00:24:35 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:37 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 1073741824" returned: 0 in 1.532s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:37 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270
Jun 26 00:24:37 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:38 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270" returned: 0 in 1.136s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] <== create_volume: return (2741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.746s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0857ee-ba47-441d-8827-074858e16b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2958d3c-4cd9-436e-90b2-df55cf7df270', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2412c40-535e-4670-a408-fa5162a4587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Volume volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 (f2958d3c-4cd9-436e-90b2-df55cf7df270): created successfully
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2412c40-535e-4670-a408-fa5162a4587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Flow 'volume_create_manager' (22cc46ab-e4bb-4fbb-9141-90312d6673e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:38 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3392bff1-b875-4ad7-a843-d1abd082668d tempest-VolumesTransfersV357Test-149110942 None] Created volume successfully.
Jun 26 00:24:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Acquiring lock "cinder-f2958d3c-4cd9-436e-90b2-df55cf7df270-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-f2958d3c-4cd9-436e-90b2-df55cf7df270-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Acquiring lock "cinder-quobyte-f2958d3c-4cd9-436e-90b2-df55cf7df270" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-quobyte-f2958d3c-4cd9-436e-90b2-df55cf7df270" acquired by "delete_volume" :: waited 0.044s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238a715-3a6e-482e-b5a3-cd474589be86]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:24:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:39 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270
Jun 26 00:24:39 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:40 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270" returned: 0 in 1.117s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:40 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270
Jun 26 00:24:40 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:41 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f2958d3c-4cd9-436e-90b2-df55cf7df270" returned: 0 in 0.821s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-quobyte-f2958d3c-4cd9-436e-90b2-df55cf7df270" released by "delete_volume" :: held 2.054s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Created reservations ['59c46fb4-1442-4113-83fe-a2b261063726', '9a489dd7-32c1-4de8-bf15-94bb2be3d87e', '1f0033a9-12b6-4968-8687-1efc0609827c', 'abb449ad-bf6e-4612-b8f6-4bbd5a45fd4d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:41 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:41 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:42 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.023s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:42 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Deleted volume successfully.
Jun 26 00:24:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0de1fcec-c186-454d-bdc5-5d82355daafd tempest-VolumesTransfersV357Test-200439435 None] Lock "cinder-f2958d3c-4cd9-436e-90b2-df55cf7df270-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "cinder-d4ee00d7-e570-42ea-991e-881590c5269e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Lock "cinder-d4ee00d7-e570-42ea-991e-881590c5269e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "cinder-quobyte-d4ee00d7-e570-42ea-991e-881590c5269e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Lock "cinder-quobyte-d4ee00d7-e570-42ea-991e-881590c5269e" acquired by "delete_volume" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:43 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad417ba1-9467-47fd-b30f-328a7bdd1bac]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:24:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:43 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e
Jun 26 00:24:43 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:44 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e" returned: 0 in 1.116s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:44 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e
Jun 26 00:24:44 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:45 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d4ee00d7-e570-42ea-991e-881590c5269e" returned: 0 in 0.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Lock "cinder-quobyte-d4ee00d7-e570-42ea-991e-881590c5269e" released by "delete_volume" :: held 2.097s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Created reservations ['3567a29c-b6d0-4502-9a26-7c47ad8040a5', 'd319350b-6545-4d90-9c98-bdbeb589949b', '30e567ab-de5f-4d3a-a19e-074ba1812cca', 'd645024f-ae3b-4a7c-9127-f631a7acdc44'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:45 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:45 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:46 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.850s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:46 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Deleted volume successfully.
Jun 26 00:24:46 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ae3739d5-fef7-463e-b252-b6cff1e8ea26 tempest-ServerActionsTestOtherA-265097809 None] Lock "cinder-d4ee00d7-e570-42ea-991e-881590c5269e-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Flow 'volume_create_manager' (985cf43b-5f73-48dd-81ac-dfa5ee824930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dac08a-c8ae-46ed-a1ad-68e9b431094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dac08a-c8ae-46ed-a1ad-68e9b431094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1837361481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6f2ae0-fde8-458b-b1d0-7798012bdd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790d82dbbb264804aa7f465b2c25dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:50Z,use_quota=True,user_id='ed75786eec0841de8e124f1fe531ed3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0fce90-2561-417a-a94f-89cc1413f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0fce90-2561-417a-a94f-89cc1413f107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ec085f-4cc4-4a66-90fb-7b626eccdec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ec085f-4cc4-4a66-90fb-7b626eccdec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6f2ae0-fde8-458b-b1d0-7798012bdd45', 'volume_name': 'volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45', 'volume_size': 2}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e53106-f5d6-4512-bd5b-9eb7b7a039ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e53106-f5d6-4512-bd5b-9eb7b7a039ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366e2056-c498-44ec-8c64-26fe5d45a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:49 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Volume 4e6f2ae0-fde8-458b-b1d0-7798012bdd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45', 'volume_size': 2}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1837361481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6f2ae0-fde8-458b-b1d0-7798012bdd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790d82dbbb264804aa7f465b2c25dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:24:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:24:50Z,use_quota=True,user_id='ed75786eec0841de8e124f1fe531ed3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Creating volume 4e6f2ae0-fde8-458b-b1d0-7798012bdd45 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:24:49 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:24:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 2147483648 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:49 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 2147483648
Jun 26 00:24:49 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:51 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 2147483648" returned: 0 in 1.129s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:51 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45
Jun 26 00:24:51 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:51 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45" returned: 0 in 0.772s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366e2056-c498-44ec-8c64-26fe5d45a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45', 'volume_size': 2}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a0436-9ec1-4284-b123-aeb88d8c5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:24:51 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Volume volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 (4e6f2ae0-fde8-458b-b1d0-7798012bdd45): created successfully
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a0436-9ec1-4284-b123-aeb88d8c5c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:24:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Flow 'volume_create_manager' (985cf43b-5f73-48dd-81ac-dfa5ee824930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:24:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1666fdec-cb37-4d50-bda5-1964fc20a2f5 tempest-VolumesCloneNegativeTest-1728100313 None] Created volume successfully.
Jun 26 00:24:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Acquiring lock "cinder-4e6f2ae0-fde8-458b-b1d0-7798012bdd45-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "cinder-4e6f2ae0-fde8-458b-b1d0-7798012bdd45-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Acquiring lock "cinder-quobyte-4e6f2ae0-fde8-458b-b1d0-7798012bdd45" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:24:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "cinder-quobyte-4e6f2ae0-fde8-458b-b1d0-7798012bdd45" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:24:53 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e1b6f-0551-4fa3-98de-d4c717515dd0]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:24:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:53 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45
Jun 26 00:24:53 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:54 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45" returned: 0 in 0.858s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:54 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45
Jun 26 00:24:54 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:55 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4e6f2ae0-fde8-458b-b1d0-7798012bdd45" returned: 0 in 0.785s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "cinder-quobyte-4e6f2ae0-fde8-458b-b1d0-7798012bdd45" released by "delete_volume" :: held 1.695s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Created reservations ['a8ed03be-3ba7-4d38-9a4d-2cbd0410e85f', 'd997ad30-3470-461f-84ee-729d4a7bdfa5', '94e11730-f3ee-4edb-b29f-27f7e555fb63', 'f6a0c0bc-6ce1-4772-8185-69e40c8bc6bd'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:24:55 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:24:55 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:24:55 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:24:55 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:24:56 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Deleted volume successfully.
Jun 26 00:24:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1f22523d-2f5e-4f7f-8848-058ae70bbe39 tempest-VolumesCloneNegativeTest-1728100313 None] Lock "cinder-4e6f2ae0-fde8-458b-b1d0-7798012bdd45-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Flow 'volume_create_manager' (66c6f63d-e97c-4cc7-86a9-cd1470a41624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ce5912-39c9-40c0-9c4b-ce78a44f91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ce5912-39c9-40c0-9c4b-ce78a44f91bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1691633050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbc28a5-92c0-4cf8-87b6-a5f738c5e957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608473837c004a519d1426c860f6423c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:01Z,use_quota=True,user_id='703ce84a885e4401a458e54698a26e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b47416-a583-4d0f-9904-7849c46d9d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b47416-a583-4d0f-9904-7849c46d9d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7776e2a-4f8a-451c-9149-027af36538a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Flow 'volume_create_manager' (45a01d98-cf6d-4e1e-9710-b6ed930cac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5cdac1-9790-4ed0-88e1-547426229002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:01 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5cdac1-9790-4ed0-88e1-547426229002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1019258337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416fbdc2-f2bb-4c68-a11e-3f40e0a98d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0714797ba704907b1bad6ad1180110a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:01Z,use_quota=True,user_id='951e618b708f431291da04d6a9ceb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:01 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31088d7a-157b-4884-9408-833258825fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31088d7a-157b-4884-9408-833258825fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fde300-db93-412f-b5c8-4f42a865a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fde300-db93-412f-b5c8-4f42a865a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416fbdc2-f2bb-4c68-a11e-3f40e0a98d94', 'volume_name': 'volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51f9fa4-1623-4a39-971c-98489bc14ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51f9fa4-1623-4a39-971c-98489bc14ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e16545-3a03-4dbe-9f61-04fde99a717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Volume 416fbdc2-f2bb-4c68-a11e-3f40e0a98d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94', 'volume_size': 1}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1019258337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416fbdc2-f2bb-4c68-a11e-3f40e0a98d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0714797ba704907b1bad6ad1180110a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:01Z,use_quota=True,user_id='951e618b708f431291da04d6a9ceb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Creating volume 416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:25:01 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:25:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:01 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 1073741824
Jun 26 00:25:01 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7776e2a-4f8a-451c-9149-027af36538a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9dbc28a5-92c0-4cf8-87b6-a5f738c5e957', 'volume_name': 'volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459fdd940>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:02 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c676119-ef91-4e3c-bed0-e7151e124d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c676119-ef91-4e3c-bed0-e7151e124d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b91970b-e9be-40fc-9886-4e653048e12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Volume 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459fdd940>}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Trying to clone 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 from image d33d2e37-1f9c-49c4-8c97-bf2e836714db at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.363s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 8 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:25:02 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81a1e55-e6b0-47b6-9294-98421e71eed9]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:03 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 1073741824" returned: 0 in 1.833s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:03 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD
Jun 26 00:25:03 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:03 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94
Jun 26 00:25:03 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:03 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD" returned: 0 in 0.979s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:03 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db is fetched for user 703ce84a885e4401a458e54698a26e9a. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:DELETE=7,cinder:SELECT=43,cinder:UPDATE=56,cinder:INSERT=20 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba13c82-190c-4983-8f0b-f99001eee52c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:04 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" returned: 0 in 1.155s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] <== create_volume: return (3053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:25:04 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD
Jun 26 00:25:04 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.055s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e16545-3a03-4dbe-9f61-04fde99a717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54b34a8-d217-41c9-a18e-9ca215c46ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:04 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Volume volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 (416fbdc2-f2bb-4c68-a11e-3f40e0a98d94): created successfully
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54b34a8-d217-41c9-a18e-9ca215c46ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Flow 'volume_create_manager' (45a01d98-cf6d-4e1e-9710-b6ed930cac9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b22e34fd-4a7a-44b5-89c9-df5d15a0e029 tempest-AttachVolumeTestJSON-885307347 None] Created volume successfully.
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD" returned: 0 in 0.991s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:05 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1691633050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbc28a5-92c0-4cf8-87b6-a5f738c5e957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608473837c004a519d1426c860f6423c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:01Z,use_quota=True,user_id='703ce84a885e4401a458e54698a26e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Creating volume 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:25:05 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:25:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:05 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 1073741824
Jun 26 00:25:05 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:06 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 1073741824" returned: 0 in 1.253s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:06 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:06 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:07 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 0 in 0.886s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:25:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:07 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Attempting download of d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:25:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e7473-85fb-42c0-8efd-da38e644fc11]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:07 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m
Jun 26 00:25:07 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:08 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m" returned: 0 in 0.943s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:08 devstack sudo[99915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m
Jun 26 00:25:08 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:08 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb46148-f8c2-4791-89c7-4298bd7ccece]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:08 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94
Jun 26 00:25:08 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:09 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m" returned: 1 in 0.987s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zg_uye1m' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[71549a65-72fd-41e6-a17c-71cedf478d86]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:09 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD
Jun 26 00:25:09 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:09 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" returned: 0 in 1.305s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.330s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd59bb03b-c362-4dec-9048-20cd86f3cf9e', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:25:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-8de2465a-97e0-4c9f-9e2b-a9238f1a6951 req-1573a381-4807-4234-ab02-54ba35d9c25a tempest-AttachVolumeTestJSON-885307347 None] attachment_update completed successfully.
Jun 26 00:25:10 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD" returned: 0 in 1.297s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:10 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] d33d2e37-1f9c-49c4-8c97-bf2e836714db was qcow2, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:25:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:10 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:10 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:13 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 0 in 3.009s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:13 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_kbsqkm14devstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:25:13 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Converted 112.00 MB image at 37.20 MB/s
Jun 26 00:25:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:13 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 1G
Jun 26 00:25:13 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:14 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 1G" returned: 0 in 0.700s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:14 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d617813-f97d-4453-b64d-f588aab4d2ec]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:14 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:14 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:15 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 0 in 0.808s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:15 devstack sudo[100999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:15 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:15 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 1 in 0.817s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Downloaded image d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db for user 703ce84a885e4401a458e54698a26e9a is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Marking volume 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Copying metadata from image d33d2e37-1f9c-49c4-8c97-bf2e836714db to 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Creating volume glance metadata for volume 9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 backed by image d33d2e37-1f9c-49c4-8c97-bf2e836714db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b91970b-e9be-40fc-9886-4e653048e12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459fdd940>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7ea49e-4cf7-4255-8e92-0d1b8d76e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:16 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Volume volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 (9dbc28a5-92c0-4cf8-87b6-a5f738c5e957): created successfully
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7ea49e-4cf7-4255-8e92-0d1b8d76e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Flow 'volume_create_manager' (66c6f63d-e97c-4cc7-86a9-cd1470a41624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-95194c62-7c19-44e6-9385-166fd09c7d68 tempest-VolumesExtendTest-166607482 None] Created volume successfully.
Jun 26 00:25:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7544be-3e0e-4e9a-9ac7-6f01f24618df]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:17 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:17 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:18 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 0 in 1.483s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:19 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:19 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:20 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 1 in 1.382s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:25:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 2G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 2G" returned: 0 in 0.090s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:20 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ffaf994e-fb8c-4462-a3f8-0ea93a9c50d0 tempest-VolumesExtendTest-166607482 None] Extend volume completed successfully.
Jun 26 00:25:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Lock "cinder-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-quobyte-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f791e9a8-2698-4f8f-b13a-161fead3cb68]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:21 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:21 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:22 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 0 in 0.945s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:22 devstack sudo[101179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:22 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:23 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 1 in 0.849s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:23 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957
Jun 26 00:25:23 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:23 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" returned: 0 in 0.729s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957" released by "delete_volume" :: held 2.602s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Created reservations ['b4b23b22-1685-4391-b777-22568b0a39ee', '4f334c57-c129-4612-a72d-9fc4679fb1b9', '28c02409-7987-4e7a-87fe-132d49645ca8', '81d37e51-9d5e-41c4-bfc5-fc8b14871d49'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:24 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:25:24 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:24 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.702s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:24 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:25:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Deleted volume successfully.
Jun 26 00:25:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9f2a22cc-f533-4f3b-8f2b-b0baef8a6a8e tempest-VolumesExtendTest-166607482 None] Lock "cinder-9dbc28a5-92c0-4cf8-87b6-a5f738c5e957-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Flow 'volume_create_manager' (92982fc9-3700-4a83-8757-ddbda14bee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff85c1a-710f-426e-a2c8-ff0aba16c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff85c1a-710f-426e-a2c8-ff0aba16c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1797863315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69171132-3df3-4718-a813-e9f08d716302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608473837c004a519d1426c860f6423c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:25Z,use_quota=True,user_id='703ce84a885e4401a458e54698a26e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e8dd9c-4b1a-4427-9121-f5e092b847b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e8dd9c-4b1a-4427-9121-f5e092b847b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1e11f3-35e7-4072-99ab-e319b65371e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1e11f3-35e7-4072-99ab-e319b65371e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69171132-3df3-4718-a813-e9f08d716302', 'volume_name': 'volume-69171132-3df3-4718-a813-e9f08d716302', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee2823-c18b-46a4-bcfc-f88427477395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee2823-c18b-46a4-bcfc-f88427477395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ab1c2a-2630-44fc-a12f-80b3026f9269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:25 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Volume 69171132-3df3-4718-a813-e9f08d716302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69171132-3df3-4718-a813-e9f08d716302', 'volume_size': 1}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1797863315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69171132-3df3-4718-a813-e9f08d716302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608473837c004a519d1426c860f6423c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:25Z,use_quota=True,user_id='703ce84a885e4401a458e54698a26e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Creating volume 69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:25:25 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:25:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:25 devstack sudo[101193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 1073741824
Jun 26 00:25:25 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:26 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 1073741824" returned: 0 in 1.318s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=64,cinder:SELECT=54,cinder:INSERT=16,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Flow 'volume_create_manager' (d165ec2e-408a-4434-a876-350e752fdd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566e5dc6-c281-4542-a2ba-395630fbd089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566e5dc6-c281-4542-a2ba-395630fbd089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1534221209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcb34ee-fd62-4026-ad30-7cac8a78834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56b99c82174318990be10f3058b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:26Z,use_quota=True,user_id='bedb2c43871944708a0343c3e3d78e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:26 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ef1729-7560-49bf-b892-fd1b4999bc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:26 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ef1729-7560-49bf-b892-fd1b4999bc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c859bf-f1ce-4877-b4c3-55c4f2980d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c859bf-f1ce-4877-b4c3-55c4f2980d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcb34ee-fd62-4026-ad30-7cac8a78834c', 'volume_name': 'volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3831adc9-aed6-4c24-ac1d-f46bfac89e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3831adc9-aed6-4c24-ac1d-f46bfac89e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a5bfc3-3be9-4002-b13a-f8615a854577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Volume 9fcb34ee-fd62-4026-ad30-7cac8a78834c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c', 'volume_size': 1}
Jun 26 00:25:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:27 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302" returned: 0 in 0.874s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1534221209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcb34ee-fd62-4026-ad30-7cac8a78834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56b99c82174318990be10f3058b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:26Z,use_quota=True,user_id='bedb2c43871944708a0343c3e3d78e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Creating volume 9fcb34ee-fd62-4026-ad30-7cac8a78834c {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:25:27 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:27 devstack sudo[101307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c 1073741824
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ab1c2a-2630-44fc-a12f-80b3026f9269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69171132-3df3-4718-a813-e9f08d716302', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:27 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a40a4c-cc7b-466d-9cb4-e2f6f3134e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:27 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Volume volume-69171132-3df3-4718-a813-e9f08d716302 (69171132-3df3-4718-a813-e9f08d716302): created successfully
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a40a4c-cc7b-466d-9cb4-e2f6f3134e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Flow 'volume_create_manager' (92982fc9-3700-4a83-8757-ddbda14bee68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:27 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e7d95a72-2598-4034-98a8-5183c798fb05 tempest-VolumesExtendTest-166607482 None] Created volume successfully.
Jun 26 00:25:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:28 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c 1073741824" returned: 0 in 1.449s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:28 devstack sudo[101334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c
Jun 26 00:25:28 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c" returned: 0 in 0.753s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:25:29 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.047s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a5bfc3-3be9-4002-b13a-f8615a854577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d0c1cc-e7e9-431b-9774-2cb84664fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Creating offline snapshot c040fae4-dde2-4acc-a33c-f62ab0b2bd9a of volume 69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:25:29 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Volume volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c (9fcb34ee-fd62-4026-ad30-7cac8a78834c): created successfully
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d0c1cc-e7e9-431b-9774-2cb84664fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Flow 'volume_create_manager' (d165ec2e-408a-4434-a876-350e752fdd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c18f7-2a54-4076-b050-98f7837c58fc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9400057d-5c77-4a7f-8369-5f05bcf0547b tempest-AttachVolumeNegativeTest-2138445435 None] Created volume successfully.
Jun 26 00:25:30 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302
Jun 26 00:25:30 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:31 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302" returned: 0 in 1.278s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:31 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a 1G
Jun 26 00:25:31 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:32 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a 1G" returned: 0 in 1.327s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69171132-3df3-4718-a813-e9f08d716302 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:32 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69171132-3df3-4718-a813-e9f08d716302 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a
Jun 26 00:25:32 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:33 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69171132-3df3-4718-a813-e9f08d716302 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" returned: 0 in 0.748s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:33 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a is being set with open permissions: ugo+rw
Jun 26 00:25:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:33 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a
Jun 26 00:25:33 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:34 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" returned: 0 in 1.443s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:34 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info
Jun 26 00:25:34 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:36 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info" returned: 0 in 1.399s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:36 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info is being set with open permissions: ugo+rw
Jun 26 00:25:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:36 devstack sudo[101908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info
Jun 26 00:25:36 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:37 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.info" returned: 0 in 1.440s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.989s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.716s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cecaeab-139b-4d72-9002-ca7169ea5667]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d606d8f1-ec24-47aa-b205-bc10cdcd6978 tempest-VolumesExtendTest-166607482 None] Create snapshot completed successfully
Jun 26 00:25:38 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c
Jun 26 00:25:38 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:39 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c" returned: 0 in 1.671s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.747s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.371s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab28e7e-7bd5-4f1e-97c2-ca87c55741b8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '277bce8a-1dc8-42cc-bbb6-38b5ec8f6f68', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:25:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-f96b3ea0-de81-4971-b0d1-875c273a8d1c req-bbd75fca-36e7-416f-a37e-e8b947a42112 tempest-AttachVolumeNegativeTest-2138445435 None] attachment_update completed successfully.
Jun 26 00:25:39 devstack sudo[101963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302
Jun 26 00:25:39 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:40 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302" returned: 0 in 1.195s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a 2G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a 2G" returned: 0 in 0.190s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.492s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ec61a7ae-6b24-4ed5-b5ca-37c58977fd3f tempest-VolumesExtendTest-166607482 None] Extend volume completed successfully.
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-c040fae4-dde2-4acc-a33c-f62ab0b2bd9a-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Lock "cinder-c040fae4-dde2-4acc-a33c-f62ab0b2bd9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-quobyte-69171132-3df3-4718-a813-e9f08d716302" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-69171132-3df3-4718-a813-e9f08d716302" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-quobyte-c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Deleting offline snapshot c040fae4-dde2-4acc-a33c-f62ab0b2bd9a of volume 69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] snapshot_file for this snap is: volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a7798d-1737-410e-a9db-4181f86d41e7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:42 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a
Jun 26 00:25:42 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:43 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" returned: 0 in 1.171s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69171132-3df3-4718-a813-e9f08d716302(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:25:43 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f38627-212f-489f-9cd5-901216486c7d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:43 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302
Jun 26 00:25:43 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:44 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302" returned: 0 in 1.621s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:44 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a
Jun 26 00:25:44 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:47 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" returned: 0 in 2.526s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:47 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a
Jun 26 00:25:47 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:48 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302.c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" returned: 0 in 1.365s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-c040fae4-dde2-4acc-a33c-f62ab0b2bd9a" released by "_delete_snapshot" :: held 6.852s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-69171132-3df3-4718-a813-e9f08d716302" released by "delete_snapshot" :: held 6.889s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:48 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Created reservations ['a4627828-f876-4c97-8aa1-9ae6ab0433db', 'a08c38ed-dbca-4a55-9ce2-f3b98a43b096', '9c21cd27-b41a-417e-a5be-95ff54319d1f', 'b38bd4fa-52de-4fff-8a35-bf60fbdb2475'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:25:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Delete snapshot completed successfully.
Jun 26 00:25:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f2d3c271-dd44-413c-9809-126e5bd2fe56 tempest-VolumesExtendTest-166607482 None] Lock "cinder-c040fae4-dde2-4acc-a33c-f62ab0b2bd9a-delete_snapshot" released by "delete_snapshot" :: held 7.089s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-69171132-3df3-4718-a813-e9f08d716302-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Lock "cinder-69171132-3df3-4718-a813-e9f08d716302-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Acquiring lock "cinder-quobyte-69171132-3df3-4718-a813-e9f08d716302" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:25:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-69171132-3df3-4718-a813-e9f08d716302" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:25:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c2a2f8-0225-4cda-a419-e5eb7e9ec6fc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:25:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:49 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302
Jun 26 00:25:49 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:50 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302" returned: 0 in 0.824s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:50 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302
Jun 26 00:25:50 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:51 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-69171132-3df3-4718-a813-e9f08d716302" returned: 0 in 0.747s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Lock "cinder-quobyte-69171132-3df3-4718-a813-e9f08d716302" released by "delete_volume" :: held 1.653s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Created reservations ['da37a53f-77f9-440b-bc5b-ce95f2fc3ffe', '46b10496-a646-4f98-97a7-0e781bd9f0d0', '7d7f47a4-a731-4fc4-b4e0-021776c2ecd4', 'a21c323c-5a95-4c32-8707-5744b6bcdbfd'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:51 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:25:51 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:52 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.820s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:52 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:25:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Deleted volume successfully.
Jun 26 00:25:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-50bfa2d0-8352-4ab0-9909-f4986b9a634f tempest-VolumesExtendTest-166607482 None] Lock "cinder-69171132-3df3-4718-a813-e9f08d716302-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (fea2f8fc-868d-48cc-b0e9-cf552b44e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9104050-2a7d-4eb2-932e-936314994b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9104050-2a7d-4eb2-932e-936314994b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295813999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68efeb8f-e2ac-4abc-a722-a3a97711f4e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:57Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7836c18-fc5f-4133-9a36-79f37f635f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7836c18-fc5f-4133-9a36-79f37f635f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6799ced-20ed-4342-8cd2-a6c489c12a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6799ced-20ed-4342-8cd2-a6c489c12a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68efeb8f-e2ac-4abc-a722-a3a97711f4e0', 'volume_name': 'volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d450a2f-da61-4d3c-9e7c-89eab61519cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d450a2f-da61-4d3c-9e7c-89eab61519cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c084cb59-8eb2-49bf-9ae3-df3da3df39b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Volume 68efeb8f-e2ac-4abc-a722-a3a97711f4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0', 'volume_size': 1}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295813999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68efeb8f-e2ac-4abc-a722-a3a97711f4e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:57Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Creating volume 68efeb8f-e2ac-4abc-a722-a3a97711f4e0 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:25:56 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:25:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:57 devstack sudo[102222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 1073741824
Jun 26 00:25:57 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-c5332773-919e-4c1a-923e-0f71a0ffce71 req-1e125c89-98e8-40d1-89a6-aabf51f20ae5 tempest-AttachVolumeTestJSON-885307347 None] Terminate volume connection completed successfully.
Jun 26 00:25:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-c5332773-919e-4c1a-923e-0f71a0ffce71 req-1e125c89-98e8-40d1-89a6-aabf51f20ae5 tempest-AttachVolumeTestJSON-885307347 None] Deleting attachment d59bb03b-c362-4dec-9048-20cd86f3cf9e. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Flow 'volume_create_manager' (a2cef313-f52c-4a11-b5a0-981c9290aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5a2fae-0fa5-4c5c-be2d-3e96f52a23c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5a2fae-0fa5-4c5c-be2d-3e96f52a23c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-245485999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e915e40785594ba0bdd97eec61cd038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:58Z,use_quota=True,user_id='d3b4fed4abb844bf8f4b7f7710fb20ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cf5686-1a89-42b2-b9a2-1107ed7ead02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cf5686-1a89-42b2-b9a2-1107ed7ead02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6472cbd5-a384-4e21-b6bf-a540dd67f15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6472cbd5-a384-4e21-b6bf-a540dd67f15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef', 'volume_name': 'volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff3a5f0-e369-4c30-bbcb-69505701820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff3a5f0-e369-4c30-bbcb-69505701820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72ad500-5a3b-4036-aee7-e5d27e4449d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:25:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Volume 86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef', 'volume_size': 1}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:58 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 1073741824" returned: 0 in 1.766s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:25:58 devstack sudo[102250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0
Jun 26 00:25:58 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:25:59 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0" returned: 0 in 1.109s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] <== create_volume: return (2955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.963s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-245485999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e915e40785594ba0bdd97eec61cd038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:25:58Z,use_quota=True,user_id='d3b4fed4abb844bf8f4b7f7710fb20ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Creating volume 86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:25:59 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:25:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c084cb59-8eb2-49bf-9ae3-df3da3df39b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb0b017-343b-4528-a00b-c6309a76a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Volume volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 (68efeb8f-e2ac-4abc-a722-a3a97711f4e0): created successfully
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb0b017-343b-4528-a00b-c6309a76a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:00 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef 1073741824
Jun 26 00:26:00 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (fea2f8fc-868d-48cc-b0e9-cf552b44e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-07f253d6-554c-49e7-b57f-e25a12514927 tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:01 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:01 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (a59c392b-abb7-4c4e-a2ec-349080444f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ceaa384-d476-4bf2-b095-57203caf2350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ceaa384-d476-4bf2-b095-57203caf2350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753253755',display_name='tempest-VolumesGetTest-Volume-115965683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf3c820-62ef-4fa7-bd57-77c786a1b407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:02Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7b9cab-681d-4e78-bcb2-fe58d4b4e1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7b9cab-681d-4e78-bcb2-fe58d4b4e1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d8f913-f5c8-40d9-9fc3-08059dae3e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d8f913-f5c8-40d9-9fc3-08059dae3e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf3c820-62ef-4fa7-bd57-77c786a1b407', 'volume_name': 'volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2402388-ffb5-41b1-abc5-f763cec5b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2402388-ffb5-41b1-abc5-f763cec5b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf667c3-77a5-42ba-b4cd-68fed4613775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Volume 6bf3c820-62ef-4fa7-bd57-77c786a1b407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407', 'volume_size': 1}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:02 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef 1073741824" returned: 0 in 2.463s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:02 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.519s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:26:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:26:02 devstack sudo[102308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef
Jun 26 00:26:02 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:03 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef" returned: 0 in 0.906s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] <== create_volume: return (3473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.478s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753253755',display_name='tempest-VolumesGetTest-Volume-115965683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf3c820-62ef-4fa7-bd57-77c786a1b407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:02Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Creating volume 6bf3c820-62ef-4fa7-bd57-77c786a1b407 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:26:03 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72ad500-5a3b-4036-aee7-e5d27e4449d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:03 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 1073741824
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913790e5-1e77-456a-a9c9-f157cb6f2cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:03 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Volume volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef (86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef): created successfully
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913790e5-1e77-456a-a9c9-f157cb6f2cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Flow 'volume_create_manager' (a2cef313-f52c-4a11-b5a0-981c9290aea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-387ad5f8-3c73-4af4-93c6-0014f8003427 tempest-ServerRescueNegativeTestJSON-786668463 None] Created volume successfully.
Jun 26 00:26:04 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 1073741824" returned: 0 in 1.273s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:04 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=50,cinder:SELECT=54,cinder:INSERT=13,cinder:DELETE=5 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:26:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:04 devstack sudo[102330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407
Jun 26 00:26:04 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:05 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407" returned: 0 in 0.762s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf667c3-77a5-42ba-b4cd-68fed4613775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862250e4-4ade-470c-b658-843dcf1e2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:05 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Volume volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 (6bf3c820-62ef-4fa7-bd57-77c786a1b407): created successfully
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862250e4-4ade-470c-b658-843dcf1e2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (a59c392b-abb7-4c4e-a2ec-349080444f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cff64cbf-c206-4373-98f0-5c2f49c3e2c3 tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:26:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-6bf3c820-62ef-4fa7-bd57-77c786a1b407-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Lock "cinder-6bf3c820-62ef-4fa7-bd57-77c786a1b407-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-6bf3c820-62ef-4fa7-bd57-77c786a1b407" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-6bf3c820-62ef-4fa7-bd57-77c786a1b407" acquired by "delete_volume" :: waited 0.056s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ce9ed-f6fc-4cb1-bc59-7aa274bb6349]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:07 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407
Jun 26 00:26:07 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:08 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407" returned: 0 in 1.891s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:08 devstack sudo[102490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407
Jun 26 00:26:08 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:09 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6bf3c820-62ef-4fa7-bd57-77c786a1b407" returned: 0 in 1.150s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-6bf3c820-62ef-4fa7-bd57-77c786a1b407" released by "delete_volume" :: held 3.159s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Created reservations ['b376e907-5bb4-425d-893c-df58ff5c559c', 'd17795e2-8f92-48bd-8b42-3d9455d409a3', '688c590c-c0af-4247-88d8-2222748b8e07', '58f9840a-6764-42ac-aceb-305cd94932cd'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:10 devstack sudo[102504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:10 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-68efeb8f-e2ac-4abc-a722-a3a97711f4e0-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Lock "cinder-68efeb8f-e2ac-4abc-a722-a3a97711f4e0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-68efeb8f-e2ac-4abc-a722-a3a97711f4e0" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-68efeb8f-e2ac-4abc-a722-a3a97711f4e0" acquired by "delete_volume" :: waited 0.052s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4045e2-beae-449e-8841-d87c2e5ede0e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:10 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0
Jun 26 00:26:10 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:11 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.190s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:11 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:26:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-900f533b-0d71-42df-951d-f8d8378b969d tempest-VolumesGetTest-1324764232 None] Lock "cinder-6bf3c820-62ef-4fa7-bd57-77c786a1b407-delete_volume" released by "delete_volume" :: held 4.849s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:11 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0" returned: 0 in 1.156s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:11 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0
Jun 26 00:26:11 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:12 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-68efeb8f-e2ac-4abc-a722-a3a97711f4e0" returned: 0 in 1.077s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-68efeb8f-e2ac-4abc-a722-a3a97711f4e0" released by "delete_volume" :: held 2.340s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:12 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Created reservations ['d73fed4f-2e52-41b3-97f0-56f7f0fd5024', 'f6c9ba6c-83bc-4965-9f58-ede5651437fb', 'b3777978-df8b-43fa-8053-6c8847b274d1', '795525c5-7923-4073-9e00-53abee2e708f'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:13 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:13 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:13 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.675s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:26:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c8912c54-0847-428c-a69d-25cd93a52acb tempest-VolumesGetTest-1324764232 None] Lock "cinder-68efeb8f-e2ac-4abc-a722-a3a97711f4e0-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (d234ff30-13e1-4410-86b2-1e5cbf918819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e426c90a-5a08-4ecf-b859-75313c104883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e426c90a-5a08-4ecf-b859-75313c104883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-252708793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81efc017-5f04-468f-9789-cdd75db51043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:15Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc300c45-db0e-46d2-b98a-e89da18418dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc300c45-db0e-46d2-b98a-e89da18418dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b099cb3-bb9c-49e6-95d8-801bc9bf8511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b099cb3-bb9c-49e6-95d8-801bc9bf8511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81efc017-5f04-468f-9789-cdd75db51043', 'volume_name': 'volume-81efc017-5f04-468f-9789-cdd75db51043', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b27753f-add7-4d02-9705-2a1f4e507797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b27753f-add7-4d02-9705-2a1f4e507797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f7fba5-def9-480a-8a43-3fc57b1ad7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Volume 81efc017-5f04-468f-9789-cdd75db51043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81efc017-5f04-468f-9789-cdd75db51043', 'volume_size': 1}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-252708793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81efc017-5f04-468f-9789-cdd75db51043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:15Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Creating volume 81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:26:14 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:26:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:14 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 1073741824
Jun 26 00:26:14 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:17 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 1073741824" returned: 0 in 2.436s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:17 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:17 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:18 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 1.148s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] <== create_volume: return (3726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.733s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f7fba5-def9-480a-8a43-3fc57b1ad7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81efc017-5f04-468f-9789-cdd75db51043', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed23146b-8cb5-42fa-b791-fbbdc0acda79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:18 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Volume volume-81efc017-5f04-468f-9789-cdd75db51043 (81efc017-5f04-468f-9789-cdd75db51043): created successfully
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed23146b-8cb5-42fa-b791-fbbdc0acda79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (d234ff30-13e1-4410-86b2-1e5cbf918819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-755d0f6b-5582-4380-869c-0ad19056dfe1 tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (29197f0a-5bda-4601-9853-f25161a4f9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95888b32-7a8f-4e4e-a97d-e305ce688d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95888b32-7a8f-4e4e-a97d-e305ce688d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1099567721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e37d42-2df2-4ba8-876e-bda7105aa191,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=81efc017-5f04-468f-9789-cdd75db51043,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:20Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163672b5-e05f-431d-a89f-a4567254d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163672b5-e05f-431d-a89f-a4567254d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca256e77-f41c-4a58-a3bb-cb684422a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca256e77-f41c-4a58-a3bb-cb684422a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd2e37d42-2df2-4ba8-876e-bda7105aa191', 'volume_name': 'volume-d2e37d42-2df2-4ba8-876e-bda7105aa191', 'volume_size': 1, 'source_volid': '81efc017-5f04-468f-9789-cdd75db51043', 'source_volstatus': 'available'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f36d3d8-bf78-4324-a563-02bd72e76f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f36d3d8-bf78-4324-a563-02bd72e76f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3458926f-6184-49be-b761-42c236c66f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:20 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Volume d2e37d42-2df2-4ba8-876e-bda7105aa191: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d2e37d42-2df2-4ba8-876e-bda7105aa191', 'volume_size': 1, 'source_volid': '81efc017-5f04-468f-9789-cdd75db51043', 'source_volstatus': 'available'}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:20 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Cloning volume 81efc017-5f04-468f-9789-cdd75db51043 to volume d2e37d42-2df2-4ba8-876e-bda7105aa191
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Creating offline snapshot 270d4b08-1ac5-4536-ba5f-2f507e67fa5f of volume 81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[60120406-b6f7-439e-85e0-14039599a25d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:20 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:20 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:22 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 1.447s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:22 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f 1G
Jun 26 00:26:22 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:23 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f 1G" returned: 0 in 1.156s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81efc017-5f04-468f-9789-cdd75db51043 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:23 devstack sudo[102824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81efc017-5f04-468f-9789-cdd75db51043 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f
Jun 26 00:26:23 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:24 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81efc017-5f04-468f-9789-cdd75db51043 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f" returned: 0 in 0.801s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:24 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f is being set with open permissions: ugo+rw
Jun 26 00:26:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:24 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f
Jun 26 00:26:24 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:25 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f" returned: 0 in 1.050s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:25 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info
Jun 26 00:26:25 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:25 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info" returned: 0 in 0.881s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:25 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info is being set with open permissions: ugo+rw
Jun 26 00:26:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:26 devstack sudo[102911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info
Jun 26 00:26:26 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:27 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.info" returned: 0 in 1.033s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-d2e37d42-2df2-4ba8-876e-bda7105aa191" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-d2e37d42-2df2-4ba8-876e-bda7105aa191" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] snapshot: 270d4b08-1ac5-4536-ba5f-2f507e67fa5f, volume: d2e37d42-2df2-4ba8-876e-bda7105aa191,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78bb0dc-2285-428a-8d55-ded71c1ac1a4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:27 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f
Jun 26 00:26:27 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:27 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f" returned: 0 in 0.850s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81efc017-5f04-468f-9789-cdd75db51043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:26:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8cb29f-df8d-447e-beed-1a49236c45aa]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Acquiring lock "cinder-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "cinder-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Acquiring lock "cinder-quobyte-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "cinder-quobyte-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef" acquired by "delete_volume" :: waited 0.043s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca69512f-b5a9-4cba-afd8-0f4f063f5925]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:28 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:28 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:28 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef
Jun 26 00:26:28 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:29 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef" returned: 0 in 1.131s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:29 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 1.377s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:29 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:26:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:29 devstack sudo[102951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef
Jun 26 00:26:29 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:29 devstack sudo[102953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191
Jun 26 00:26:29 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:30 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef" returned: 0 in 1.094s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "cinder-quobyte-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef" released by "delete_volume" :: held 2.271s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=55,cinder:SELECT=46,cinder:INSERT=15,cinder:DELETE=3 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Created reservations ['6d505439-f3df-4899-a32a-3fb6b104e52f', '0c38caa5-c561-4c5b-97fc-85822088df66', '6d8c4590-66e8-48aa-91c9-7f183e38f16f', '94d99d1f-214a-4086-b8e3-08979794e09d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:30 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:30 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:34 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 3.843s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:34 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Deleted volume successfully.
Jun 26 00:26:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-304f949e-abe0-4619-a6ab-45c136d47520 tempest-ServerRescueNegativeTestJSON-786668463 None] Lock "cinder-86f83e4b-810b-4dc1-bf5c-f8fb5b2d1aef-delete_volume" released by "delete_volume" :: held 6.655s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:39 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191" returned: 0 in 10.436s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaae4d9-6aa5-4f48-8e26-9744df6e314f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:40 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:40 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:40 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:26:41 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 1.554s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:41 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043, size 1024.00 MB, duration 10.44 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:26:41 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Converted 1024.00 MB image at 98.09 MB/s
Jun 26 00:26:41 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 is being set with open permissions: ugo+rw
Jun 26 00:26:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:41 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191
Jun 26 00:26:41 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:42 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191" returned: 0 in 0.775s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-d2e37d42-2df2-4ba8-876e-bda7105aa191" released by "_copy_volume_from_snapshot" :: held 15.170s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-270d4b08-1ac5-4536-ba5f-2f507e67fa5f" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-270d4b08-1ac5-4536-ba5f-2f507e67fa5f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Deleting offline snapshot 270d4b08-1ac5-4536-ba5f-2f507e67fa5f of volume 81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] snapshot_file for this snap is: volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce47d5b-df1a-4980-be84-c748b10e7268]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:42 devstack sudo[103083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f
Jun 26 00:26:42 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:43 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f" returned: 0 in 0.922s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81efc017-5f04-468f-9789-cdd75db51043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:26:43 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f0fb11-cd68-42fb-9052-3d5c20945da6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:43 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:43 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:44 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 0.799s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:44 devstack sudo[103104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f
Jun 26 00:26:44 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:44 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=31,cinder:DELETE=4,cinder:SELECT=25,cinder:INSERT=10 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:26:44 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f" returned: 0 in 0.810s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:44 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f
Jun 26 00:26:44 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:45 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043.270d4b08-1ac5-4536-ba5f-2f507e67fa5f" returned: 0 in 1.037s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-270d4b08-1ac5-4536-ba5f-2f507e67fa5f" released by "_delete_snapshot" :: held 3.705s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.519s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3458926f-6184-49be-b761-42c236c66f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e37d42-2df2-4ba8-876e-bda7105aa191', 'volume_size': 1, 'source_volid': '81efc017-5f04-468f-9789-cdd75db51043', 'source_volstatus': 'available'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189dee48-72a1-4d5f-b249-220e37b06cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:46 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Volume volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 (d2e37d42-2df2-4ba8-876e-bda7105aa191): created successfully
Jun 26 00:26:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189dee48-72a1-4d5f-b249-220e37b06cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (29197f0a-5bda-4601-9853-f25161a4f9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-af67c812-e035-4f00-94ad-c8571c6591f7 tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (34c09815-3448-4fe5-8766-72885689db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547aa3bd-44b7-4904-a8bc-ea9f57c2e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547aa3bd-44b7-4904-a8bc-ea9f57c2e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-985268445',display_name='tempest-VolumesGetTest-Volume-1308229333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07acdb32-fa2b-414e-b13c-bc2936069c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:48Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b691dfdb-b064-46f3-a553-04668c04e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b691dfdb-b064-46f3-a553-04668c04e17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff6b436-80c4-409a-9dab-517a02a5dd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff6b436-80c4-409a-9dab-517a02a5dd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07acdb32-fa2b-414e-b13c-bc2936069c2a', 'volume_name': 'volume-07acdb32-fa2b-414e-b13c-bc2936069c2a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45548af-0271-4f74-80e6-e93b0fcba3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45548af-0271-4f74-80e6-e93b0fcba3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f3ee6e-15bc-4f11-ad88-b417045bdb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:47 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Volume 07acdb32-fa2b-414e-b13c-bc2936069c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07acdb32-fa2b-414e-b13c-bc2936069c2a', 'volume_size': 1}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-985268445',display_name='tempest-VolumesGetTest-Volume-1308229333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07acdb32-fa2b-414e-b13c-bc2936069c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:48Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Creating volume 07acdb32-fa2b-414e-b13c-bc2936069c2a {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:26:47 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:26:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:47 devstack sudo[103174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a 1073741824
Jun 26 00:26:47 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-4d735a2a-72b6-4a84-be72-93fb49c33306 req-ee3eb774-5e14-40bb-a877-315d39aca04f tempest-AttachVolumeNegativeTest-2138445435 None] Terminate volume connection completed successfully.
Jun 26 00:26:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-4d735a2a-72b6-4a84-be72-93fb49c33306 req-ee3eb774-5e14-40bb-a877-315d39aca04f tempest-AttachVolumeNegativeTest-2138445435 None] Deleting attachment 277bce8a-1dc8-42cc-bbb6-38b5ec8f6f68. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:26:48 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a 1073741824" returned: 0 in 0.893s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:48 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a
Jun 26 00:26:48 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:49 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a" returned: 0 in 0.687s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f3ee6e-15bc-4f11-ad88-b417045bdb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07acdb32-fa2b-414e-b13c-bc2936069c2a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4726c004-ad17-4f70-9de6-8d09430805b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:49 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Volume volume-07acdb32-fa2b-414e-b13c-bc2936069c2a (07acdb32-fa2b-414e-b13c-bc2936069c2a): created successfully
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4726c004-ad17-4f70-9de6-8d09430805b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (34c09815-3448-4fe5-8766-72885689db9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-031f5b4b-05de-46ea-a74b-6a380ee5ae3e tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-07acdb32-fa2b-414e-b13c-bc2936069c2a-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Lock "cinder-07acdb32-fa2b-414e-b13c-bc2936069c2a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-07acdb32-fa2b-414e-b13c-bc2936069c2a" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-07acdb32-fa2b-414e-b13c-bc2936069c2a" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac4608-a974-4567-a8c6-af7c257c7867]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:50 devstack sudo[103188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a
Jun 26 00:26:50 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:50 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a" returned: 0 in 0.856s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:50 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a
Jun 26 00:26:50 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:51 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-07acdb32-fa2b-414e-b13c-bc2936069c2a" returned: 0 in 0.656s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-07acdb32-fa2b-414e-b13c-bc2936069c2a" released by "delete_volume" :: held 1.561s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Created reservations ['7e83dc5f-7743-42cb-8864-de5b6d698f92', '61592a24-a356-4a1f-9275-1c85e163a6d6', 'ab191156-cd62-4dce-b35e-7319c4358ac2', '378a97d1-84d9-4d35-8cb2-3dd9fb278733'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:51 devstack sudo[103213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:51 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-d2e37d42-2df2-4ba8-876e-bda7105aa191-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Lock "cinder-d2e37d42-2df2-4ba8-876e-bda7105aa191-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-d2e37d42-2df2-4ba8-876e-bda7105aa191" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-d2e37d42-2df2-4ba8-876e-bda7105aa191" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[66060761-e888-405d-84d2-0e3923abc37a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:52 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.898s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:26:52 devstack sudo[103242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191
Jun 26 00:26:52 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4cf7f07b-72cf-4862-a028-ba7b456b814c tempest-VolumesGetTest-1324764232 None] Lock "cinder-07acdb32-fa2b-414e-b13c-bc2936069c2a-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:53 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191" returned: 0 in 0.927s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:53 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191
Jun 26 00:26:53 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:54 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d2e37d42-2df2-4ba8-876e-bda7105aa191" returned: 0 in 0.870s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-d2e37d42-2df2-4ba8-876e-bda7105aa191" released by "delete_volume" :: held 1.860s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Created reservations ['0ba8ee0d-4531-4957-9b57-d45718cce646', '610f723b-8a6f-4fd1-998b-c74c4fb18e16', '037a5413-ead0-467c-8954-07b3fc131439', '0ce4ef38-d031-45ca-a4ac-7538592de953'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:54 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:54 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-81efc017-5f04-468f-9789-cdd75db51043-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Lock "cinder-81efc017-5f04-468f-9789-cdd75db51043-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-81efc017-5f04-468f-9789-cdd75db51043" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-81efc017-5f04-468f-9789-cdd75db51043" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c804822-5562-4097-9e28-be83809abf17]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:54 devstack sudo[103259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:54 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:55 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.739s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:55 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:26:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e34743-e460-4cf9-843f-4f041ef263e8 tempest-VolumesGetTest-1324764232 None] Lock "cinder-d2e37d42-2df2-4ba8-876e-bda7105aa191-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:55 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 1.016s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:55 devstack sudo[103267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043
Jun 26 00:26:55 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:56 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-81efc017-5f04-468f-9789-cdd75db51043" returned: 0 in 0.713s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-81efc017-5f04-468f-9789-cdd75db51043" released by "delete_volume" :: held 1.812s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Created reservations ['68bdbcc5-4c9d-4311-b805-d8ab11190b74', '8ce0a325-cd6c-4363-892e-e5fd6a2ac701', 'c77b94cf-5183-4cdf-8fb5-44a5d556db53', 'a9bd5e1a-8495-4f6f-8c26-cc34ecf7b22f'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:26:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:56 devstack sudo[103271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:26:56 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:26:57 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.813s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:26:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8446e0c4-b0c8-4160-a674-bfb265d929c4 tempest-VolumesGetTest-1324764232 None] Lock "cinder-81efc017-5f04-468f-9789-cdd75db51043-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (b7c8ffdf-b9f3-477f-84a9-2705aade4dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2df48f-b69b-4a55-988d-5f1bd6991492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2df48f-b69b-4a55-988d-5f1bd6991492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2796702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4496f29-a751-4125-a9e8-ebb0f3837a5d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:58Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966a0d14-d065-4f8f-8804-be95696c1ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966a0d14-d065-4f8f-8804-be95696c1ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead482b-4625-404d-a83c-ca18b286187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:57 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:26:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead482b-4625-404d-a83c-ca18b286187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4496f29-a751-4125-a9e8-ebb0f3837a5d', 'volume_name': 'volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459dfe9f0>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e0b5d3-c0e0-4212-b335-10c688de477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e0b5d3-c0e0-4212-b335-10c688de477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:26:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc71cad-5e1e-49b9-afc4-7a25ac3b4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:26:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Volume b4496f29-a751-4125-a9e8-ebb0f3837a5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459dfe9f0>}
Jun 26 00:26:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Trying to clone b4496f29-a751-4125-a9e8-ebb0f3837a5d from image d33d2e37-1f9c-49c4-8c97-bf2e836714db at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:26:59 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:26:59 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 00:26:59 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2c132-b944-4359-9d73-f68a44739f1f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:26:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:26:59 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD
Jun 26 00:26:59 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:00 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD" returned: 0 in 1.080s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db is fetched for user 13f921c89f1b4f91b03e62856dd895f6. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde46ec-80b8-4771-b0ba-d8c9cb184f85]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:00 devstack sudo[103325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD
Jun 26 00:27:00 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:01 devstack sudo[103333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:27:01 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:01 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD" returned: 0 in 0.882s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2796702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4496f29-a751-4125-a9e8-ebb0f3837a5d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:26:58Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Creating volume b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:27:01 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:01 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d 1073741824
Jun 26 00:27:01 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:01 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.949s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:27:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:27:02 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d 1073741824" returned: 0 in 1.092s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:02 devstack sudo[103348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:02 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:03 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:27:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:03 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Attempting download of d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume b4496f29-a751-4125-a9e8-ebb0f3837a5d. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:27:03 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f919f7f-dac6-4fdf-b5e8-e4362f1a1812]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:03 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p
Jun 26 00:27:03 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:04 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p" returned: 0 in 1.043s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:04 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p
Jun 26 00:27:04 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:05 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p" returned: 1 in 0.914s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_z6_sua7p' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:27:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f4d2f-574f-44e9-9e7d-1cec581b77fc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:05 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD
Jun 26 00:27:05 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:06 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD" returned: 0 in 0.966s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:06 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] d33d2e37-1f9c-49c4-8c97-bf2e836714db was qcow2, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:27:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:06 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:06 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:08 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 0 in 2.491s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:08 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_vb1b0_v9devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:27:08 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Converted 112.00 MB image at 44.87 MB/s
Jun 26 00:27:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:08 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d 1G
Jun 26 00:27:08 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:09 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d 1G" returned: 0 in 1.100s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[50616bd2-79e7-42ce-b1c8-11fa6582624a]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:10 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:10 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:11 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 0 in 1.290s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:11 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:11 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:12 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 1 in 1.036s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Downloaded image d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume b4496f29-a751-4125-a9e8-ebb0f3837a5d successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db for user 13f921c89f1b4f91b03e62856dd895f6 is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Marking volume b4496f29-a751-4125-a9e8-ebb0f3837a5d as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Copying metadata from image d33d2e37-1f9c-49c4-8c97-bf2e836714db to b4496f29-a751-4125-a9e8-ebb0f3837a5d. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Creating volume glance metadata for volume b4496f29-a751-4125-a9e8-ebb0f3837a5d backed by image d33d2e37-1f9c-49c4-8c97-bf2e836714db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc71cad-5e1e-49b9-afc4-7a25ac3b4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459dfe9f0>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8690dd-af1f-434c-9f3e-d1d9cb155648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:12 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Volume volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d (b4496f29-a751-4125-a9e8-ebb0f3837a5d): created successfully
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8690dd-af1f-434c-9f3e-d1d9cb155648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (b7c8ffdf-b9f3-477f-84a9-2705aade4dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-269df17b-401c-422b-99c6-c1fa724081b8 tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (4c964d7c-6804-40a2-b974-3abe2caf3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6dbf57-8d80-4c88-8d6c-5ac7a9ef0a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6dbf57-8d80-4c88-8d6c-5ac7a9ef0a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-707652862',display_name='tempest-VolumesGetTest-Volume-1628034390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100a96dd-b7a1-4a4f-8be1-5ca775703a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:14Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adefc5ec-1190-429c-b03c-c7fffb105540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adefc5ec-1190-429c-b03c-c7fffb105540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7719fbc4-e31a-4f94-beb9-35c32de4956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7719fbc4-e31a-4f94-beb9-35c32de4956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100a96dd-b7a1-4a4f-8be1-5ca775703a6e', 'volume_name': 'volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297b292d-9be7-4d04-ac2b-3f36c96d7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297b292d-9be7-4d04-ac2b-3f36c96d7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3661cef-f91e-41e0-8ca5-cbcc503a4357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Volume 100a96dd-b7a1-4a4f-8be1-5ca775703a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e', 'volume_size': 1}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-707652862',display_name='tempest-VolumesGetTest-Volume-1628034390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100a96dd-b7a1-4a4f-8be1-5ca775703a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529acffbab0f4274903180c106e082db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:14Z,use_quota=True,user_id='13f921c89f1b4f91b03e62856dd895f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Creating volume 100a96dd-b7a1-4a4f-8be1-5ca775703a6e {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:27:14 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:27:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:14 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e 1073741824
Jun 26 00:27:14 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:15 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e 1073741824" returned: 0 in 0.873s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:15 devstack sudo[103430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e
Jun 26 00:27:15 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:15 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e" returned: 0 in 0.696s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3661cef-f91e-41e0-8ca5-cbcc503a4357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab92eaa-d4eb-489f-b833-b392b80d3983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:15 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Volume volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e (100a96dd-b7a1-4a4f-8be1-5ca775703a6e): created successfully
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab92eaa-d4eb-489f-b833-b392b80d3983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Flow 'volume_create_manager' (4c964d7c-6804-40a2-b974-3abe2caf3913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-52a7d9e4-f4e6-477f-aebb-1814eb28d673 tempest-VolumesGetTest-1324764232 None] Created volume successfully.
Jun 26 00:27:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-100a96dd-b7a1-4a4f-8be1-5ca775703a6e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Lock "cinder-100a96dd-b7a1-4a4f-8be1-5ca775703a6e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-100a96dd-b7a1-4a4f-8be1-5ca775703a6e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-100a96dd-b7a1-4a4f-8be1-5ca775703a6e" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d797cb5-a2df-4591-9662-99b8f17d576f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:16 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e
Jun 26 00:27:16 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:17 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e" returned: 0 in 0.779s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:17 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e
Jun 26 00:27:17 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:17 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100a96dd-b7a1-4a4f-8be1-5ca775703a6e" returned: 0 in 0.676s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-100a96dd-b7a1-4a4f-8be1-5ca775703a6e" released by "delete_volume" :: held 1.512s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:17 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Created reservations ['595aaa69-aa5b-4daf-bc10-9571f9e03c76', 'b7a4aaf6-b945-4220-a269-7d02999f1367', 'dbbfb2c4-a62e-446b-a135-651c868a7536', '65fc82b1-0714-496b-bc25-4e01e8b23206'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:18 devstack sudo[103445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:27:18 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-b4496f29-a751-4125-a9e8-ebb0f3837a5d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Lock "cinder-b4496f29-a751-4125-a9e8-ebb0f3837a5d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Acquiring lock "cinder-quobyte-b4496f29-a751-4125-a9e8-ebb0f3837a5d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-b4496f29-a751-4125-a9e8-ebb0f3837a5d" acquired by "delete_volume" :: waited 0.047s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:18 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.961s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:19 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:27:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:27:19 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd2e05-f403-489b-a2d6-531202aecb35]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3f1fa106-b771-4487-a159-2b76040cd314 tempest-VolumesGetTest-1324764232 None] Lock "cinder-100a96dd-b7a1-4a4f-8be1-5ca775703a6e-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:19 devstack sudo[103462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:19 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:20 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 0 in 1.665s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:20 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:20 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:21 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 1 in 1.171s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:27:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:21 devstack sudo[103587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d
Jun 26 00:27:21 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:23 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b4496f29-a751-4125-a9e8-ebb0f3837a5d" returned: 0 in 1.570s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Lock "cinder-quobyte-b4496f29-a751-4125-a9e8-ebb0f3837a5d" released by "delete_volume" :: held 4.567s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Created reservations ['0b760fcf-9679-4ede-b09a-71ee580fe803', '7da9fdd3-3a2e-45fc-a9b7-e898671ae991', '9b24df9a-3265-445f-901d-97d2c95e61d1', '2e1aa392-ab59-4fbe-b17a-eeb73c213cf1'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:23 devstack sudo[103614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:27:23 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:24 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.244s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:24 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:27:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Deleted volume successfully.
Jun 26 00:27:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a89b5b43-c1c1-4465-b0a6-7cff6238dadf tempest-VolumesGetTest-1324764232 None] Lock "cinder-b4496f29-a751-4125-a9e8-ebb0f3837a5d-delete_volume" released by "delete_volume" :: held 6.240s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Flow 'volume_create_manager' (ce93e7f0-8989-4919-bc97-77ca988d5239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffc65e8-0eaf-40a1-8a3d-994af8d27971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffc65e8-0eaf-40a1-8a3d-994af8d27971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-682831252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21508e5-6cf6-432e-b267-b743cc8a241d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd48caa66454499a1d59d83e7a6dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:30Z,use_quota=True,user_id='758eff4ff777465095dc4dc31686b9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d403b6f-f94c-4af5-aff1-970612b78146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d403b6f-f94c-4af5-aff1-970612b78146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f053197-b405-4a12-a545-9efd064d0097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f053197-b405-4a12-a545-9efd064d0097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21508e5-6cf6-432e-b267-b743cc8a241d', 'volume_name': 'volume-b21508e5-6cf6-432e-b267-b743cc8a241d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e200ffe-97c5-46d7-9c8b-5df8cb9e4066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e200ffe-97c5-46d7-9c8b-5df8cb9e4066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463d5697-9767-4e75-bf26-9469b412f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:29 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Volume b21508e5-6cf6-432e-b267-b743cc8a241d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21508e5-6cf6-432e-b267-b743cc8a241d', 'volume_size': 1}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-682831252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21508e5-6cf6-432e-b267-b743cc8a241d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd48caa66454499a1d59d83e7a6dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:30Z,use_quota=True,user_id='758eff4ff777465095dc4dc31686b9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Creating volume b21508e5-6cf6-432e-b267-b743cc8a241d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:27:29 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:27:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:30 devstack sudo[103707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d 1073741824
Jun 26 00:27:30 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:32 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d 1073741824" returned: 0 in 2.067s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:32 devstack sudo[103725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d
Jun 26 00:27:32 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:34 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d" returned: 0 in 1.929s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] <== create_volume: return (4135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.140s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463d5697-9767-4e75-bf26-9469b412f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21508e5-6cf6-432e-b267-b743cc8a241d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cb1c2a-7dae-4cc0-b6d0-b7f7ebe70f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Volume volume-b21508e5-6cf6-432e-b267-b743cc8a241d (b21508e5-6cf6-432e-b267-b743cc8a241d): created successfully
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cb1c2a-7dae-4cc0-b6d0-b7f7ebe70f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Flow 'volume_create_manager' (ce93e7f0-8989-4919-bc97-77ca988d5239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-94d78c60-e8fb-4e4e-9265-5d2adc09312f tempest-VolumesListTestJSON-704678308 None] Created volume successfully.
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Flow 'volume_create_manager' (570a2c4f-890c-4572-829e-8616c59031fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf120256-4b0a-4525-9d7e-47b23dd61682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf120256-4b0a-4525-9d7e-47b23dd61682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-488100505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb30bb5-5c3c-4fb7-8a47-833e284f060a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd48caa66454499a1d59d83e7a6dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:36Z,use_quota=True,user_id='758eff4ff777465095dc4dc31686b9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69e72af-075f-461c-a572-599806717e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69e72af-075f-461c-a572-599806717e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef1ca69-db97-4cad-8699-488276314ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef1ca69-db97-4cad-8699-488276314ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb30bb5-5c3c-4fb7-8a47-833e284f060a', 'volume_name': 'volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9b3212-4f93-46c0-a54e-581d6067cdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9b3212-4f93-46c0-a54e-581d6067cdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666daff0-1d9f-483c-bc6a-2706af88c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:35 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Volume ceb30bb5-5c3c-4fb7-8a47-833e284f060a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a', 'volume_size': 1}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-488100505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb30bb5-5c3c-4fb7-8a47-833e284f060a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd48caa66454499a1d59d83e7a6dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:36Z,use_quota=True,user_id='758eff4ff777465095dc4dc31686b9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Creating volume ceb30bb5-5c3c-4fb7-8a47-833e284f060a {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:27:35 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:27:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:35 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a 1073741824
Jun 26 00:27:35 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:36 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a 1073741824" returned: 0 in 1.150s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:37 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a
Jun 26 00:27:37 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:37 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a" returned: 0 in 0.816s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666daff0-1d9f-483c-bc6a-2706af88c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b8b607-d893-46aa-b7ad-8e9ee8cc4745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:37 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Volume volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a (ceb30bb5-5c3c-4fb7-8a47-833e284f060a): created successfully
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b8b607-d893-46aa-b7ad-8e9ee8cc4745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Flow 'volume_create_manager' (570a2c4f-890c-4572-829e-8616c59031fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:38 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a7a28b56-c93a-485e-b3f0-eb3b153ec659 tempest-VolumesListTestJSON-704678308 None] Created volume successfully.
Jun 26 00:27:39 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:27:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Flow 'volume_create_manager' (2f81d086-0ad4-4e0d-bede-124d312c8942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5e2cff-155d-46b1-bcb6-24950ceb571c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5e2cff-155d-46b1-bcb6-24950ceb571c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-266232048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bf8857-ca48-481b-8807-cdf9fc437019,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd48caa66454499a1d59d83e7a6dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:40Z,use_quota=True,user_id='758eff4ff777465095dc4dc31686b9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7453b981-775d-4f62-814d-2abceb850476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7453b981-775d-4f62-814d-2abceb850476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b73bf88-92ed-41e3-936c-1913122d6ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b73bf88-92ed-41e3-936c-1913122d6ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bf8857-ca48-481b-8807-cdf9fc437019', 'volume_name': 'volume-93bf8857-ca48-481b-8807-cdf9fc437019', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe1759f-e1a1-4213-a857-ef7296cc5057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe1759f-e1a1-4213-a857-ef7296cc5057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6a34cc-9c3d-44d0-88c8-e5e546ce8f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:40 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Volume 93bf8857-ca48-481b-8807-cdf9fc437019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bf8857-ca48-481b-8807-cdf9fc437019', 'volume_size': 1}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-266232048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bf8857-ca48-481b-8807-cdf9fc437019,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd48caa66454499a1d59d83e7a6dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:40Z,use_quota=True,user_id='758eff4ff777465095dc4dc31686b9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Creating volume 93bf8857-ca48-481b-8807-cdf9fc437019 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:27:40 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:27:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:40 devstack sudo[103833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019 1073741824
Jun 26 00:27:40 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:41 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019 1073741824" returned: 0 in 1.270s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:41 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=61,cinder:INSERT=24,cinder:DELETE=6,cinder:SELECT=45 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:27:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:41 devstack sudo[103839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019
Jun 26 00:27:41 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:43 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019" returned: 0 in 1.624s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] <== create_volume: return (2965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6a34cc-9c3d-44d0-88c8-e5e546ce8f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bf8857-ca48-481b-8807-cdf9fc437019', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57e0e61-80c8-4e88-9cc4-6b4bd45f45c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:43 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Volume volume-93bf8857-ca48-481b-8807-cdf9fc437019 (93bf8857-ca48-481b-8807-cdf9fc437019): created successfully
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57e0e61-80c8-4e88-9cc4-6b4bd45f45c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Flow 'volume_create_manager' (2f81d086-0ad4-4e0d-bede-124d312c8942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-32779d29-99ba-4181-ba4c-df80ab87bc4a tempest-VolumesListTestJSON-704678308 None] Created volume successfully.
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=63,cinder:SELECT=49,cinder:INSERT=16,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Flow 'volume_create_manager' (74734242-920b-4acd-912c-80f5c4b64753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00feb61-95d6-4970-85ec-f124e56f4194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00feb61-95d6-4970-85ec-f124e56f4194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-805191231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63166b1-6d92-430f-85ca-97bb1610ed5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56b99c82174318990be10f3058b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:47Z,use_quota=True,user_id='bedb2c43871944708a0343c3e3d78e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd42002-77bd-492a-97c5-7c8311764403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd42002-77bd-492a-97c5-7c8311764403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1b032e-ab30-4347-a1a3-f049635f0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1b032e-ab30-4347-a1a3-f049635f0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63166b1-6d92-430f-85ca-97bb1610ed5a', 'volume_name': 'volume-d63166b1-6d92-430f-85ca-97bb1610ed5a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8a4e86-d594-454f-b74a-81dd475f16bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8a4e86-d594-454f-b74a-81dd475f16bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d916e01-ae5f-4174-848f-312f12ddd493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:46 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Volume d63166b1-6d92-430f-85ca-97bb1610ed5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63166b1-6d92-430f-85ca-97bb1610ed5a', 'volume_size': 1}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-805191231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63166b1-6d92-430f-85ca-97bb1610ed5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56b99c82174318990be10f3058b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:27:47Z,use_quota=True,user_id='bedb2c43871944708a0343c3e3d78e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Creating volume d63166b1-6d92-430f-85ca-97bb1610ed5a {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:27:46 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:27:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:47 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a 1073741824
Jun 26 00:27:47 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:48 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a 1073741824" returned: 0 in 1.072s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:48 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a
Jun 26 00:27:48 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:49 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a" returned: 0 in 0.921s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Acquiring lock "cinder-93bf8857-ca48-481b-8807-cdf9fc437019-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d916e01-ae5f-4174-848f-312f12ddd493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63166b1-6d92-430f-85ca-97bb1610ed5a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3501332-9929-4c50-ba76-be4bd75dd7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-93bf8857-ca48-481b-8807-cdf9fc437019-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:49 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Volume volume-d63166b1-6d92-430f-85ca-97bb1610ed5a (d63166b1-6d92-430f-85ca-97bb1610ed5a): created successfully
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3501332-9929-4c50-ba76-be4bd75dd7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Flow 'volume_create_manager' (74734242-920b-4acd-912c-80f5c4b64753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:27:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0765a219-d24e-4cd8-bc04-b41769bf4871 tempest-AttachVolumeNegativeTest-2138445435 None] Created volume successfully.
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Acquiring lock "cinder-quobyte-93bf8857-ca48-481b-8807-cdf9fc437019" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-quobyte-93bf8857-ca48-481b-8807-cdf9fc437019" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b537fc7-8559-41b4-84c0-5655127c50c0]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:49 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019
Jun 26 00:27:49 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:49 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019" returned: 0 in 0.820s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:50 devstack sudo[103939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019
Jun 26 00:27:50 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:50 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-93bf8857-ca48-481b-8807-cdf9fc437019" returned: 0 in 0.699s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-quobyte-93bf8857-ca48-481b-8807-cdf9fc437019" released by "delete_volume" :: held 1.569s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Created reservations ['95531cd3-ad33-401b-8bcd-cd8e76fbe4db', 'ca0044c8-4218-4fea-b466-9a8fda746d28', '5d0ab587-2c1c-40d0-8eb4-5ff995d42dd4', 'a4b2f7c2-74a1-4244-8380-69d4d8f62461'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:50 devstack sudo[103960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:27:50 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Acquiring lock "cinder-ceb30bb5-5c3c-4fb7-8a47-833e284f060a-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-ceb30bb5-5c3c-4fb7-8a47-833e284f060a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Acquiring lock "cinder-quobyte-ceb30bb5-5c3c-4fb7-8a47-833e284f060a" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-quobyte-ceb30bb5-5c3c-4fb7-8a47-833e284f060a" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb222c9f-acc2-44f1-909a-2f5c6e0d4152]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:51 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.718s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:27:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Deleted volume successfully.
Jun 26 00:27:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-84aef427-1df1-44c8-bf00-bf7798f9860b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-93bf8857-ca48-481b-8807-cdf9fc437019-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:51 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a
Jun 26 00:27:51 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:52 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a" returned: 0 in 1.279s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:52 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a
Jun 26 00:27:52 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:53 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-ceb30bb5-5c3c-4fb7-8a47-833e284f060a" returned: 0 in 0.899s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-quobyte-ceb30bb5-5c3c-4fb7-8a47-833e284f060a" released by "delete_volume" :: held 2.304s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fda0a17-5bbe-4d4a-ba64-a385d37f5fa5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:53 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Created reservations ['2d74517f-15ea-45d7-be2b-3b16bc5db49b', '6153cbde-ac99-4a5d-8512-c6ffa34a55ed', 'fb108b8f-1a15-41fe-b56b-ad8d0e9cb5f4', 'a0db053b-83ea-4f8d-bcbe-561a666c5bc5'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:27:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:54 devstack sudo[104039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a
Jun 26 00:27:54 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:54 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:27:54 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Acquiring lock "cinder-b21508e5-6cf6-432e-b267-b743cc8a241d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Lock "cinder-b21508e5-6cf6-432e-b267-b743cc8a241d-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:55 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.155s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:27:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Deleted volume successfully.
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Acquiring lock "cinder-quobyte-b21508e5-6cf6-432e-b267-b743cc8a241d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9290566c-7964-4f60-a596-7a360b9a157b tempest-VolumesListTestJSON-704678308 None] Lock "cinder-ceb30bb5-5c3c-4fb7-8a47-833e284f060a-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Lock "cinder-quobyte-b21508e5-6cf6-432e-b267-b743cc8a241d" acquired by "delete_volume" :: waited 0.052s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0499eac9-5143-4e3b-b18a-e5724d60e06b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:55 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a" returned: 0 in 1.666s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.706s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-d63166b1-6d92-430f-85ca-97bb1610ed5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f930c4af-b560-4961-9304-17c4618218b8', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:27:55 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d
Jun 26 00:27:55 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-42087e77-4d17-4a15-87cb-59a430f24f42 req-5b89af9b-f65d-4ce1-bbbc-3cebd7beedd3 tempest-AttachVolumeNegativeTest-2138445435 None] attachment_update completed successfully.
Jun 26 00:27:56 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d" returned: 0 in 1.006s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:56 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d
Jun 26 00:27:56 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:57 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b21508e5-6cf6-432e-b267-b743cc8a241d" returned: 0 in 1.069s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Lock "cinder-quobyte-b21508e5-6cf6-432e-b267-b743cc8a241d" released by "delete_volume" :: held 2.139s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Created reservations ['2c79c984-5b8e-4ab0-b7cb-2779dd37f307', 'abb2ae01-d188-479c-81ad-a7d4ef2a1fe0', '4c68923b-fb90-43b6-95bb-a3fd36d9d54e', '66cad797-622b-40a4-9496-5ee2292af1ef'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:27:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:27:57 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:27:57 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:27:58 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Jun 26 00:27:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:27:58 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:27:58 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Deleted volume successfully.
Jun 26 00:27:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c55bd7cf-09ba-4be3-9082-73d8c44b1425 tempest-VolumesListTestJSON-704678308 None] Lock "cinder-b21508e5-6cf6-432e-b267-b743cc8a241d-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Flow 'volume_create_manager' (71b152dd-e83e-49ab-92c9-3e33c51c9d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228b5956-ba77-4e5f-a98a-ea747121531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228b5956-ba77-4e5f-a98a-ea747121531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1523681633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d04c305-d777-4eef-adb6-9af7c2cf12aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0714797ba704907b1bad6ad1180110a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:00Z,use_quota=True,user_id='951e618b708f431291da04d6a9ceb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a44c6d6-4ad1-4d74-abfd-f9947afa8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a44c6d6-4ad1-4d74-abfd-f9947afa8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353a7096-57f7-4298-b1e9-54c647435d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353a7096-57f7-4298-b1e9-54c647435d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d04c305-d777-4eef-adb6-9af7c2cf12aa', 'volume_name': 'volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a5440c-52b8-49ba-b9fe-4f8ecc6f0c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a5440c-52b8-49ba-b9fe-4f8ecc6f0c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e5ceb0-6068-4d2a-bb26-66a3c24ecce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Volume 3d04c305-d777-4eef-adb6-9af7c2cf12aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa', 'volume_size': 1}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1523681633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d04c305-d777-4eef-adb6-9af7c2cf12aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0714797ba704907b1bad6ad1180110a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:00Z,use_quota=True,user_id='951e618b708f431291da04d6a9ceb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Creating volume 3d04c305-d777-4eef-adb6-9af7c2cf12aa {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:28:00 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:00 devstack sudo[104488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa 1073741824
Jun 26 00:28:00 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:01 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:28:01 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:01 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa 1073741824" returned: 0 in 1.005s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:01 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa
Jun 26 00:28:01 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:01 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.755s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:28:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:28:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-b5d1830e-d3b7-4ac6-9036-be803611827e req-6af14f18-ad5e-4474-8dd2-beb0851fd0f8 tempest-AttachVolumeNegativeTest-2138445435 None] Terminate volume connection completed successfully.
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-b5d1830e-d3b7-4ac6-9036-be803611827e req-6af14f18-ad5e-4474-8dd2-beb0851fd0f8 tempest-AttachVolumeNegativeTest-2138445435 None] Deleting attachment f930c4af-b560-4961-9304-17c4618218b8. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:28:02 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa" returned: 0 in 0.925s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e5ceb0-6068-4d2a-bb26-66a3c24ecce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51e0e6-988c-4431-8158-f8d555b6c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Volume volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa (3d04c305-d777-4eef-adb6-9af7c2cf12aa): created successfully
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51e0e6-988c-4431-8158-f8d555b6c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Flow 'volume_create_manager' (71b152dd-e83e-49ab-92c9-3e33c51c9d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-92b91e53-73a1-4b30-bbf4-7ec357f11395 tempest-AttachVolumeTestJSON-885307347 None] Created volume successfully.
Jun 26 00:28:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:28:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Flow 'volume_create_manager' (42a0fde1-8915-4126-92f7-a9640596e081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557f42d9-b116-429c-ae28-16e8def3a846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557f42d9-b116-429c-ae28-16e8def3a846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1150718209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf93ce06-33b0-4b12-981a-1f94a2b9bfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312d8fa02c4f442db2b157b5377fc0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:04Z,use_quota=True,user_id='f8eeb86113b74470ae4890a918e8ae19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c0ec0-afb3-4d16-ad06-ab5aea924aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c0ec0-afb3-4d16-ad06-ab5aea924aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3908661-8121-4dbc-be0c-8ed9e8c696a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3908661-8121-4dbc-be0c-8ed9e8c696a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf93ce06-33b0-4b12-981a-1f94a2b9bfe6', 'volume_name': 'volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ecc053-9c2f-49fe-b60e-7321344a297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ecc053-9c2f-49fe-b60e-7321344a297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254dc7a1-4115-4db4-bf12-828994e8afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:04 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Volume bf93ce06-33b0-4b12-981a-1f94a2b9bfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6', 'volume_size': 1}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1150718209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf93ce06-33b0-4b12-981a-1f94a2b9bfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312d8fa02c4f442db2b157b5377fc0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:04Z,use_quota=True,user_id='f8eeb86113b74470ae4890a918e8ae19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Creating volume bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:28:04 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:28:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:04 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 1073741824
Jun 26 00:28:04 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:05 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 1073741824" returned: 0 in 0.984s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:05 devstack sudo[104550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6
Jun 26 00:28:05 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:06 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6" returned: 0 in 1.056s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254dc7a1-4115-4db4-bf12-828994e8afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0da9f4-8d67-474e-a684-daed8cb7d04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:06 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Volume volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 (bf93ce06-33b0-4b12-981a-1f94a2b9bfe6): created successfully
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0da9f4-8d67-474e-a684-daed8cb7d04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Flow 'volume_create_manager' (42a0fde1-8915-4126-92f7-a9640596e081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:06 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-42ec8768-00cc-41b8-909b-bc7d70d6ad18 tempest-ServersNegativeTestJSON-1425905997 None] Created volume successfully.
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb3bbc4-3371-4b8e-ba15-f5dd8b24083d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:07 devstack sudo[104598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa
Jun 26 00:28:07 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:07 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa" returned: 0 in 1.018s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.039s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ad1afd2-7f7a-42cd-93e3-9e83d2a3f797', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:28:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-55682edc-5707-4b65-8733-bcaa2eb8d092 req-b3c9a43b-9bff-4e6a-9e83-cf7853db3152 tempest-AttachVolumeTestJSON-885307347 None] attachment_update completed successfully.
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Flow 'volume_create_manager' (a4929af0-b32a-404b-9d36-5e3ca89b91c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da8d3c5-37dc-4612-ae85-9d076026964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da8d3c5-37dc-4612-ae85-9d076026964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1251660915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c242992-8f0b-4884-8de4-88855e43bcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312d8fa02c4f442db2b157b5377fc0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:10Z,use_quota=True,user_id='f8eeb86113b74470ae4890a918e8ae19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dab47ed-bca4-4936-9f11-05b565bd811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dab47ed-bca4-4936-9f11-05b565bd811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bce479-d453-442a-ae29-2f73ead3d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bce479-d453-442a-ae29-2f73ead3d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c242992-8f0b-4884-8de4-88855e43bcf5', 'volume_name': 'volume-9c242992-8f0b-4884-8de4-88855e43bcf5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfcecc5-6ed7-4cd0-8546-b5e50e532dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfcecc5-6ed7-4cd0-8546-b5e50e532dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5ee244-f48b-4c54-a0f8-887af76335e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:10 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Volume 9c242992-8f0b-4884-8de4-88855e43bcf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c242992-8f0b-4884-8de4-88855e43bcf5', 'volume_size': 1}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1251660915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c242992-8f0b-4884-8de4-88855e43bcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312d8fa02c4f442db2b157b5377fc0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:10Z,use_quota=True,user_id='f8eeb86113b74470ae4890a918e8ae19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Creating volume 9c242992-8f0b-4884-8de4-88855e43bcf5 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:28:10 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:28:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:10 devstack sudo[104994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5 1073741824
Jun 26 00:28:10 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:11 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5 1073741824" returned: 0 in 1.061s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:11 devstack sudo[105001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5
Jun 26 00:28:11 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:12 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5" returned: 0 in 0.761s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5ee244-f48b-4c54-a0f8-887af76335e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c242992-8f0b-4884-8de4-88855e43bcf5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a75b12-dec3-439b-9b4e-5fed16b0099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:12 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Volume volume-9c242992-8f0b-4884-8de4-88855e43bcf5 (9c242992-8f0b-4884-8de4-88855e43bcf5): created successfully
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a75b12-dec3-439b-9b4e-5fed16b0099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Flow 'volume_create_manager' (a4929af0-b32a-404b-9d36-5e3ca89b91c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9b329e51-78f4-4b58-9cea-e98e3b99d917 tempest-ServersNegativeTestJSON-1425905997 None] Created volume successfully.
Jun 26 00:28:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "cinder-9c242992-8f0b-4884-8de4-88855e43bcf5-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-9c242992-8f0b-4884-8de4-88855e43bcf5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "cinder-quobyte-9c242992-8f0b-4884-8de4-88855e43bcf5" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-quobyte-9c242992-8f0b-4884-8de4-88855e43bcf5" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[990adf3e-45be-4eec-984c-c0952270e824]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:14 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5
Jun 26 00:28:14 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Flow 'volume_create_manager' (2da2ac3e-ac28-4274-b64b-ad4b321f4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265c818d-c1c7-403f-88c4-5f82d5ab2a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265c818d-c1c7-403f-88c4-5f82d5ab2a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-873256631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc297dd-97ba-4bbd-b969-418d0237edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0714797ba704907b1bad6ad1180110a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:14Z,use_quota=True,user_id='951e618b708f431291da04d6a9ceb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b215a83-93ea-46b3-aa5f-ea47cf3eb984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b215a83-93ea-46b3-aa5f-ea47cf3eb984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e19bd8-4eb6-42f6-9ef2-19c1b50457f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e19bd8-4eb6-42f6-9ef2-19c1b50457f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc297dd-97ba-4bbd-b969-418d0237edad', 'volume_name': 'volume-dfc297dd-97ba-4bbd-b969-418d0237edad', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed782b64-10d7-4243-91e2-9fc093a47535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed782b64-10d7-4243-91e2-9fc093a47535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef0a8b2-c100-48f7-8aa5-d3250c9dfdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Volume dfc297dd-97ba-4bbd-b969-418d0237edad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc297dd-97ba-4bbd-b969-418d0237edad', 'volume_size': 1}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-873256631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc297dd-97ba-4bbd-b969-418d0237edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0714797ba704907b1bad6ad1180110a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:14Z,use_quota=True,user_id='951e618b708f431291da04d6a9ceb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Creating volume dfc297dd-97ba-4bbd-b969-418d0237edad {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:28:14 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:28:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:14 devstack sudo[105007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad 1073741824
Jun 26 00:28:14 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:15 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5" returned: 0 in 1.147s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:15 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5
Jun 26 00:28:15 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:15 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad 1073741824" returned: 0 in 1.102s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:15 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad
Jun 26 00:28:15 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:15 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9c242992-8f0b-4884-8de4-88855e43bcf5" returned: 0 in 0.756s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-quobyte-9c242992-8f0b-4884-8de4-88855e43bcf5" released by "delete_volume" :: held 1.987s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Created reservations ['d397a262-f302-4c2b-a764-2ce08309daec', 'd34f67a1-56aa-4b57-92e3-b008750715e6', 'cc02c2f2-e01e-4d83-92db-2d7c85e2a88a', '1dc1d4f5-7f28-4459-9e88-fc81e8459492'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:16 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:28:16 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "cinder-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "cinder-quobyte-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-quobyte-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6" acquired by "delete_volume" :: waited 0.064s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1103d1bb-9a35-4274-aeea-f6204077b7bf]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:16 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6
Jun 26 00:28:16 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:17 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad" returned: 0 in 1.375s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.534s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef0a8b2-c100-48f7-8aa5-d3250c9dfdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc297dd-97ba-4bbd-b969-418d0237edad', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895a21f2-8363-4212-be9f-20cb08972dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:17 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Volume volume-dfc297dd-97ba-4bbd-b969-418d0237edad (dfc297dd-97ba-4bbd-b969-418d0237edad): created successfully
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895a21f2-8363-4212-be9f-20cb08972dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Flow 'volume_create_manager' (2da2ac3e-ac28-4274-b64b-ad4b321f4537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2440d652-298c-4dd0-82b9-32281319ac8c tempest-AttachVolumeTestJSON-885307347 None] Created volume successfully.
Jun 26 00:28:17 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.229s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:28:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Deleted volume successfully.
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b4c0eac-81aa-4178-8bd6-51f2b553bf31 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-9c242992-8f0b-4884-8de4-88855e43bcf5-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:17 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6" returned: 0 in 1.127s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:17 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6
Jun 26 00:28:17 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:18 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6" returned: 0 in 0.844s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-quobyte-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6" released by "delete_volume" :: held 2.083s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Created reservations ['ed9d8686-dc46-4a6b-bd52-cacc36b037f8', '981acb5f-5f6d-4b07-a6a8-cce4a5a74d10', '6e9496e7-bce8-467a-8b14-be1ea8918534', 'bb96e992-b5f3-4082-ae5d-a3c5af9b4f79'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:18 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:28:18 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:19 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.924s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:19 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:28:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Deleted volume successfully.
Jun 26 00:28:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80c22790-c1bb-424b-83ce-9c0d615d3ee0 tempest-ServersNegativeTestJSON-1425905997 None] Lock "cinder-bf93ce06-33b0-4b12-981a-1f94a2b9bfe6-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ca370e-665a-4afe-9dc8-3cabab28db08]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:21 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad
Jun 26 00:28:21 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:21 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad" returned: 0 in 1.053s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.073s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-dfc297dd-97ba-4bbd-b969-418d0237edad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a34f6b4-4ae9-4b22-96a0-db7563145a31', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:28:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-eb811d99-8439-4271-84e9-52652ff6eb98 req-48cd06bd-d42a-48de-8f66-8f584d64c9b5 tempest-AttachVolumeTestJSON-885307347 None] attachment_update completed successfully.
Jun 26 00:28:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-350436bd-e85a-4ae9-9dc2-08410f746d29 req-868e945e-24ae-4d92-8a79-f253fe9fb8a0 tempest-AttachVolumeTestJSON-885307347 None] Terminate volume connection completed successfully.
Jun 26 00:28:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-350436bd-e85a-4ae9-9dc2-08410f746d29 req-868e945e-24ae-4d92-8a79-f253fe9fb8a0 tempest-AttachVolumeTestJSON-885307347 None] Deleting attachment 5ad1afd2-7f7a-42cd-93e3-9e83d2a3f797. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:28:32 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=64,cinder:SELECT=54,cinder:INSERT=14,cinder:DELETE=5 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:28:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-c13534dd-2d4b-43a0-80fc-e87d177c7b6e req-3bf266a0-91ab-4bdf-a455-6868b54d4191 tempest-AttachVolumeTestJSON-885307347 None] Terminate volume connection completed successfully.
Jun 26 00:28:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-c13534dd-2d4b-43a0-80fc-e87d177c7b6e req-3bf266a0-91ab-4bdf-a455-6868b54d4191 tempest-AttachVolumeTestJSON-885307347 None] Deleting attachment 8a34f6b4-4ae9-4b22-96a0-db7563145a31. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Flow 'volume_create_manager' (49db82ac-2642-456b-a335-214de717ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d73fdd1-f233-4cdd-ab01-b8e9f578e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d73fdd1-f233-4cdd-ab01-b8e9f578e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-347208847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bd0698a994ff7bd15638583d3e3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:33Z,use_quota=True,user_id='e1b77b685c904e9a8e8d3610a1ee7a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2000d08b-8e7a-4d9a-9153-6949c987d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2000d08b-8e7a-4d9a-9153-6949c987d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc27a326-1ec7-4ac3-83e3-cc7426a270a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc27a326-1ec7-4ac3-83e3-cc7426a270a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809', 'volume_name': 'volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459d2af00>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751310df-06ba-4c87-8c7c-878c957cb71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751310df-06ba-4c87-8c7c-878c957cb71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7e6784-3052-43b0-a76d-e6c44ed214d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:33 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Volume 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459d2af00>}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Trying to clone 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 from image d33d2e37-1f9c-49c4-8c97-bf2e836714db at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:28:33 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:28:33 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 00:28:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c487e-a6f0-4afb-92c5-7a6e884adbdd]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:34 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD
Jun 26 00:28:34 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:34 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD" returned: 0 in 0.879s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:34 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db is fetched for user e1b77b685c904e9a8e8d3610a1ee7a76. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:28:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5278c7-9d1c-4caa-a6a6-c7de0b534099]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:35 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD
Jun 26 00:28:35 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:36 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD" returned: 0 in 1.250s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-347208847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0bd0698a994ff7bd15638583d3e3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:28:33Z,use_quota=True,user_id='e1b77b685c904e9a8e8d3610a1ee7a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Creating volume 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:28:36 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:28:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:36 devstack sudo[105325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 1073741824
Jun 26 00:28:36 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:37 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 1073741824" returned: 0 in 1.564s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:37 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:28:37 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:39 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 1.156s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] <== create_volume: return (2794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:28:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.797s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:39 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Attempting download of d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:28:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0419ba6d-4bc1-4f90-a7a2-521f753367f7]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:39 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6
Jun 26 00:28:39 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:40 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6" returned: 0 in 0.993s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:40 devstack sudo[105383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6
Jun 26 00:28:40 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:41 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6" returned: 1 in 1.156s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_zzerksy6' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:28:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b071a9-169c-42e6-968b-cb555189200a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:41 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD
Jun 26 00:28:41 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:42 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD" returned: 0 in 1.123s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:42 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] d33d2e37-1f9c-49c4-8c97-bf2e836714db was qcow2, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:28:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:42 devstack sudo[105394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:28:42 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b6ce11cf-76e7-4831-b40d-56b85b9bac58 tempest-BackendsCapabilitiesAdminTestsJSON-1312030130 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94563) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ac94a1e8-2d14-4da2-bfc4-d992fc747355 tempest-BackendsCapabilitiesAdminTestsJSON-1312030130 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94563) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "cinder-dfc297dd-97ba-4bbd-b969-418d0237edad-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-dfc297dd-97ba-4bbd-b969-418d0237edad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "cinder-quobyte-dfc297dd-97ba-4bbd-b969-418d0237edad" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-quobyte-dfc297dd-97ba-4bbd-b969-418d0237edad" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fa8c3f-1767-4bbf-ac98-bd1c72cae934]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:44 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad
Jun 26 00:28:44 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:44 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 2.247s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_lb9kmt7vdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:28:44 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Converted 112.00 MB image at 49.81 MB/s
Jun 26 00:28:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:44 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 1G
Jun 26 00:28:44 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:45 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad" returned: 0 in 0.915s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:45 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad
Jun 26 00:28:45 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:45 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 1G" returned: 0 in 0.953s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:45 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5587ba6-1fff-41a9-b878-9e8a0b9877e3]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:45 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:28:45 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:46 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-dfc297dd-97ba-4bbd-b969-418d0237edad" returned: 0 in 1.089s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-quobyte-dfc297dd-97ba-4bbd-b969-418d0237edad" released by "delete_volume" :: held 2.055s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Created reservations ['0798202a-ca15-4af9-aa26-b79c0281abeb', 'e48a5c53-5125-4f71-928a-07cd55d30fb9', 'c9246fd0-7758-4472-b3f8-52e47f0dcf38', 'f8d586fb-978c-4868-80b4-864ff12660f7'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:46 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:28:46 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:46 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 1.042s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:47 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:28:47 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "cinder-3d04c305-d777-4eef-adb6-9af7c2cf12aa-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-3d04c305-d777-4eef-adb6-9af7c2cf12aa-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=62,cinder:UPDATE=70,cinder:INSERT=14,cinder:DELETE=5 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "cinder-quobyte-3d04c305-d777-4eef-adb6-9af7c2cf12aa" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:47 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.268s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-quobyte-3d04c305-d777-4eef-adb6-9af7c2cf12aa" acquired by "delete_volume" :: waited 0.029s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:47 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Deleted volume successfully.
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e2c320-2e7a-4b8f-ba97-ab1fb1298d90]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5fedb007-97ba-4381-9511-99fadd0e7129 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-dfc297dd-97ba-4bbd-b969-418d0237edad-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:48 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa
Jun 26 00:28:48 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:48 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 1 in 1.514s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Downloaded image d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db for user e1b77b685c904e9a8e8d3610a1ee7a76 is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Marking volume 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Copying metadata from image d33d2e37-1f9c-49c4-8c97-bf2e836714db to 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Creating volume glance metadata for volume 7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 backed by image d33d2e37-1f9c-49c4-8c97-bf2e836714db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7e6784-3052-43b0-a76d-e6c44ed214d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459d2af00>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe6f72f-e29b-4ca0-8ae3-87ecc1927588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:28:48 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Volume volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 (7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809): created successfully
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe6f72f-e29b-4ca0-8ae3-87ecc1927588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:28:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Flow 'volume_create_manager' (49db82ac-2642-456b-a335-214de717ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:28:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fea92c98-9284-49f9-b83e-d95c63a922fb tempest-TestShelveInstance-1224411811 None] Created volume successfully.
Jun 26 00:28:49 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa" returned: 0 in 1.087s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:49 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa
Jun 26 00:28:49 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:49 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3d04c305-d777-4eef-adb6-9af7c2cf12aa" returned: 0 in 0.731s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-quobyte-3d04c305-d777-4eef-adb6-9af7c2cf12aa" released by "delete_volume" :: held 1.892s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Created reservations ['f45db20b-637d-4c9e-8cbc-2501d8a7c13d', '4995628a-4b63-416f-8e90-9c3384f8fec3', '566abb0f-d05f-4ab4-848d-af703f37c479', 'd33e41b0-d1dc-480b-afd7-71ef72a30964'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:50 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:28:50 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "cinder-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "cinder-quobyte-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:28:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-quobyte-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" acquired by "delete_volume" :: waited 0.034s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:28:50 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a7eda8-74d5-4640-ba6d-d068012e892c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:50 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94
Jun 26 00:28:50 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:50 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.031s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:51 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:28:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Deleted volume successfully.
Jun 26 00:28:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-faa69454-e0fe-48d1-b3e2-004281aff575 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-3d04c305-d777-4eef-adb6-9af7c2cf12aa-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:51 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" returned: 0 in 1.326s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:51 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94
Jun 26 00:28:51 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:52 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" returned: 0 in 0.801s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-quobyte-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94" released by "delete_volume" :: held 2.185s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Created reservations ['438a67cc-9fb1-4600-9668-963192a614ce', '373d43c4-9fee-4540-b696-36a51c64a0e5', '0218246e-5011-4260-a0e2-b2b6c8b88c58', 'f5d54759-87d6-459f-a9f1-fa48deeb013e'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:28:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:52 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:28:52 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:53 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.685s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:53 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:28:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Deleted volume successfully.
Jun 26 00:28:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-18a980cb-9126-4a6f-a2cd-caa5ce8a13e5 tempest-AttachVolumeTestJSON-885307347 None] Lock "cinder-416fbdc2-f2bb-4c68-a11e-3f40e0a98d94-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:28:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:28:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:28:57 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc512d-f0c1-4530-9f80-41d2dd6c8321]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:28:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:57 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:28:57 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:28:59 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jun 26 00:28:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 1.621s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:28:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:28:59 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:28:59 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:00 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 1 in 1.010s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.710s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1727db97-2d92-4767-b78c-6badfd1586fb', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:29:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-f9bca160-8c12-44f4-b594-6b197fdf672b req-f2729463-658f-471f-8ddd-b267e09375f1 tempest-TestShelveInstance-1224411811 None] attachment_update completed successfully.
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:01 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:01 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:01 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.840s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:29:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:29:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Flow 'volume_create_manager' (fa7e7b84-32fe-4c95-ae24-c2631d54ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231624ad-26e9-461c-aef2-b9b57f226479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231624ad-26e9-461c-aef2-b9b57f226479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-634367301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978df337-a600-4e18-aa28-642645d11741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56b99c82174318990be10f3058b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:03Z,use_quota=True,user_id='bedb2c43871944708a0343c3e3d78e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7aefbc-2769-4dcf-8b32-d3f68c7bde74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7aefbc-2769-4dcf-8b32-d3f68c7bde74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1ccd91-5a72-4f5c-8e89-823b78e40bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1ccd91-5a72-4f5c-8e89-823b78e40bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978df337-a600-4e18-aa28-642645d11741', 'volume_name': 'volume-978df337-a600-4e18-aa28-642645d11741', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361b3612-9ca3-48f3-82b8-8151340b45d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361b3612-9ca3-48f3-82b8-8151340b45d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b6f53-af10-4100-aae7-7a0785b99e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Volume 978df337-a600-4e18-aa28-642645d11741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978df337-a600-4e18-aa28-642645d11741', 'volume_size': 1}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-634367301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978df337-a600-4e18-aa28-642645d11741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56b99c82174318990be10f3058b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:03Z,use_quota=True,user_id='bedb2c43871944708a0343c3e3d78e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Creating volume 978df337-a600-4e18-aa28-642645d11741 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:03 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:03 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 1073741824
Jun 26 00:29:03 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Flow 'volume_create_manager' (fb67a420-2b5e-41fd-b384-ee6bdd5450b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebce72ef-202f-45b0-9477-f790169bafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebce72ef-202f-45b0-9477-f790169bafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1232538517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502eb997-c30a-4f4f-b53e-659a40714418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c288115d4e49d0aec5dd46ea40cffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:04Z,use_quota=True,user_id='7b2f946a0a564dcb86dd6bfca8713595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fdd825-cbba-4a23-8c2e-1bd53d234d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fdd825-cbba-4a23-8c2e-1bd53d234d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6257649-5453-4a76-87d1-f3188e99b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6257649-5453-4a76-87d1-f3188e99b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502eb997-c30a-4f4f-b53e-659a40714418', 'volume_name': 'volume-502eb997-c30a-4f4f-b53e-659a40714418', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90095ce-1aba-4a03-87b8-f789e8f1d04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90095ce-1aba-4a03-87b8-f789e8f1d04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec688489-f6e5-4408-857b-a3a814d4e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Volume 502eb997-c30a-4f4f-b53e-659a40714418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502eb997-c30a-4f4f-b53e-659a40714418', 'volume_size': 1}
Jun 26 00:29:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:04 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 1073741824" returned: 0 in 0.963s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:04 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741
Jun 26 00:29:04 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:05 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741" returned: 0 in 0.763s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1232538517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502eb997-c30a-4f4f-b53e-659a40714418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c288115d4e49d0aec5dd46ea40cffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:04Z,use_quota=True,user_id='7b2f946a0a564dcb86dd6bfca8713595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Creating volume 502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:05 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b6f53-af10-4100-aae7-7a0785b99e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978df337-a600-4e18-aa28-642645d11741', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:05 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 1073741824
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fec5c1d-70a9-419a-9012-8b43346a0626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:05 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:05 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Volume volume-978df337-a600-4e18-aa28-642645d11741 (978df337-a600-4e18-aa28-642645d11741): created successfully
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fec5c1d-70a9-419a-9012-8b43346a0626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Flow 'volume_create_manager' (fa7e7b84-32fe-4c95-ae24-c2631d54ef09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-070b8270-f847-4e49-8704-b7c71cb5ac80 tempest-AttachVolumeNegativeTest-2138445435 None] Created volume successfully.
Jun 26 00:29:06 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 1073741824" returned: 0 in 1.024s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:06 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418
Jun 26 00:29:06 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:07 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418" returned: 0 in 1.213s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec688489-f6e5-4408-857b-a3a814d4e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502eb997-c30a-4f4f-b53e-659a40714418', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1575ff-1234-4c45-9ff0-2df61a425b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:07 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Volume volume-502eb997-c30a-4f4f-b53e-659a40714418 (502eb997-c30a-4f4f-b53e-659a40714418): created successfully
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1575ff-1234-4c45-9ff0-2df61a425b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Flow 'volume_create_manager' (fb67a420-2b5e-41fd-b384-ee6bdd5450b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:07 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-837bc995-e4b0-4fc0-8be8-af23daadc1c8 req-3d1a9767-ac92-4e44-9f03-dadb35de88e0 tempest-VolumesSnapshotsTestJSON-1328008095 None] Created volume successfully.
Jun 26 00:29:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Creating offline snapshot 779dd8e1-04c7-44ed-86e6-a7c7a9799e05 of volume 502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:29:08 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eb88c3-8ce2-4da4-8d2e-0c472e44c7bd]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:08 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418
Jun 26 00:29:08 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:09 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418" returned: 0 in 1.328s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:09 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 1G
Jun 26 00:29:10 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:11 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 1G" returned: 0 in 1.463s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502eb997-c30a-4f4f-b53e-659a40714418 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:11 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502eb997-c30a-4f4f-b53e-659a40714418 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05
Jun 26 00:29:11 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:12 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502eb997-c30a-4f4f-b53e-659a40714418 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05" returned: 0 in 0.895s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:12 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 is being set with open permissions: ugo+rw
Jun 26 00:29:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:12 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05
Jun 26 00:29:12 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:13 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05" returned: 0 in 0.912s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:13 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info
Jun 26 00:29:13 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:14 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info" returned: 0 in 1.210s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:14 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info is being set with open permissions: ugo+rw
Jun 26 00:29:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:14 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info
Jun 26 00:29:14 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:15 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.info" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.774s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.841s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d9783e-c533-40f4-a3f5-908bf7866478]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-63a1d039-7541-4011-89aa-c78995f35b8e req-61fd415d-eb2b-4ef0-92ee-fc74ac336788 tempest-VolumesSnapshotsTestJSON-1328008095 None] Create snapshot completed successfully
Jun 26 00:29:15 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741
Jun 26 00:29:15 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Flow 'volume_create_manager' (ff7948b6-2a71-46be-be62-0c6674c34f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986f3945-52f7-4f9f-a23b-e7cdffa36ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986f3945-52f7-4f9f-a23b-e7cdffa36ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1291432764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283f312f-5474-4cde-a7d6-2bdf3421f6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea7d807cb9b409fa9e0df26d7d83f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:16Z,use_quota=True,user_id='9030cf44338a437aa5ce59558a78393f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2151d8bb-3ab0-4285-ac52-4ba8e62222e3),volume_type_id=2151d8bb-3ab0-4285-ac52-4ba8e62222e3)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d22d6a-351c-4201-9898-38a92229da30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d22d6a-351c-4201-9898-38a92229da30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09526b56-3fd1-4883-9838-4fa3d0263d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09526b56-3fd1-4883-9838-4fa3d0263d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283f312f-5474-4cde-a7d6-2bdf3421f6c5', 'volume_name': 'volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec47048-7a91-457c-a403-6c706fe6dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec47048-7a91-457c-a403-6c706fe6dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411a00aa-b7fd-4459-ad7c-8a644cd45af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:16 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Volume 283f312f-5474-4cde-a7d6-2bdf3421f6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5', 'volume_size': 1}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:16 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741" returned: 0 in 0.909s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.092s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1291432764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283f312f-5474-4cde-a7d6-2bdf3421f6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea7d807cb9b409fa9e0df26d7d83f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:16Z,use_quota=True,user_id='9030cf44338a437aa5ce59558a78393f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2151d8bb-3ab0-4285-ac52-4ba8e62222e3),volume_type_id=2151d8bb-3ab0-4285-ac52-4ba8e62222e3)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Creating volume 283f312f-5474-4cde-a7d6-2bdf3421f6c5 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:16 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:16 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 1073741824
Jun 26 00:29:16 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-978df337-a600-4e18-aa28-642645d11741', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b584e7d3-38e7-4bf0-a25a-bfa73b974566', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:29:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-2cd5fe78-8348-4a08-a9d9-188b78a6d7d4 req-2cdc1a6c-5573-40a9-8b3c-2e55894093d3 tempest-AttachVolumeNegativeTest-2138445435 None] attachment_update completed successfully.
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "cinder-779dd8e1-04c7-44ed-86e6-a7c7a9799e05-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-779dd8e1-04c7-44ed-86e6-a7c7a9799e05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "cinder-quobyte-502eb997-c30a-4f4f-b53e-659a40714418" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-quobyte-502eb997-c30a-4f4f-b53e-659a40714418" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "cinder-quobyte-779dd8e1-04c7-44ed-86e6-a7c7a9799e05" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-quobyte-779dd8e1-04c7-44ed-86e6-a7c7a9799e05" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Deleting offline snapshot 779dd8e1-04c7-44ed-86e6-a7c7a9799e05 of volume 502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] snapshot_file for this snap is: volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371646e-d7d9-4bfe-97fa-991011a581a5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:16 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05
Jun 26 00:29:16 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:17 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 1073741824" returned: 0 in 0.928s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:17 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5
Jun 26 00:29:17 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:17 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05" returned: 0 in 0.917s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-502eb997-c30a-4f4f-b53e-659a40714418(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c565511-a81f-4365-8d02-fce8ddce968e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:17 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418
Jun 26 00:29:17 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:17 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5" returned: 0 in 0.719s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411a00aa-b7fd-4459-ad7c-8a644cd45af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b734212-99f9-457f-8d3b-20d0e0a55946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:18 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Volume volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 (283f312f-5474-4cde-a7d6-2bdf3421f6c5): created successfully
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b734212-99f9-457f-8d3b-20d0e0a55946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Flow 'volume_create_manager' (ff7948b6-2a71-46be-be62-0c6674c34f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b4a5c88e-9c0a-49de-b3a3-7539662aef1a tempest-VolumeTypesAccessTest-2025841626 None] Created volume successfully.
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Acquiring lock "cinder-283f312f-5474-4cde-a7d6-2bdf3421f6c5-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Lock "cinder-283f312f-5474-4cde-a7d6-2bdf3421f6c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Acquiring lock "cinder-quobyte-283f312f-5474-4cde-a7d6-2bdf3421f6c5" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Lock "cinder-quobyte-283f312f-5474-4cde-a7d6-2bdf3421f6c5" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703e6bc-b4e7-40e6-882e-cee606796617]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:18 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5
Jun 26 00:29:18 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:18 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418" returned: 0 in 0.947s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:18 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05
Jun 26 00:29:18 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:19 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5" returned: 0 in 0.856s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:19 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5
Jun 26 00:29:19 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:19 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05" returned: 0 in 0.811s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:19 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05
Jun 26 00:29:19 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:20 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-283f312f-5474-4cde-a7d6-2bdf3421f6c5" returned: 0 in 0.750s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Lock "cinder-quobyte-283f312f-5474-4cde-a7d6-2bdf3421f6c5" released by "delete_volume" :: held 1.660s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:20 devstack cinder-volume[94563]: WARNING cinder.quota [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1032565806 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1032565806, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:29:20 devstack cinder-volume[94563]: WARNING cinder.quota [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1032565806 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1032565806, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:29:20 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418.779dd8e1-04c7-44ed-86e6-a7c7a9799e05" returned: 0 in 0.735s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Created reservations ['0cfbf029-b233-4975-a32a-194aed1efcc7', 'f838ca88-39d0-4718-9fbf-8dee6be9e1f1', '50f50a77-b0fb-4e7a-8432-06b9f3191ebf', '57335d0a-8546-4937-a598-75d0c40d4428'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-quobyte-779dd8e1-04c7-44ed-86e6-a7c7a9799e05" released by "_delete_snapshot" :: held 3.538s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-quobyte-502eb997-c30a-4f4f-b53e-659a40714418" released by "delete_snapshot" :: held 3.575s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:20 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:20 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.quota [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Created reservations ['81cc5444-3a09-41c2-a6f9-4dea12217950', 'cf7c05f7-cee4-42d5-841a-c534d4ed901c', '9875b160-5235-4c52-9d1e-bab645165ea8', '566b30d8-c1f6-4a51-8abc-476deef251d7'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:20 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Delete snapshot completed successfully.
Jun 26 00:29:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-1699fe2b-b6af-4407-a8fb-41128ed00a46 req-d02f8083-365c-4bcb-a6f8-55a30fc0f93d tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-779dd8e1-04c7-44ed-86e6-a7c7a9799e05-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "cinder-502eb997-c30a-4f4f-b53e-659a40714418-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-502eb997-c30a-4f4f-b53e-659a40714418-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "cinder-quobyte-502eb997-c30a-4f4f-b53e-659a40714418" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-quobyte-502eb997-c30a-4f4f-b53e-659a40714418" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:21 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.037s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:21 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Deleted volume successfully.
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c9e0e-3af0-4489-bdf1-a15aa63e7ba5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9025006f-989b-4491-83a6-4112d0c0a5e1 tempest-VolumeTypesAccessTest-2025841626 None] Lock "cinder-283f312f-5474-4cde-a7d6-2bdf3421f6c5-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:21 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418
Jun 26 00:29:21 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:22 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418" returned: 0 in 0.910s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:22 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418
Jun 26 00:29:22 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-858b76b3-d198-4032-a85f-664e305d23f9 req-db681014-2a1a-4730-94c5-91c2054ac1e5 tempest-AttachVolumeNegativeTest-2138445435 None] Terminate volume connection completed successfully.
Jun 26 00:29:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-858b76b3-d198-4032-a85f-664e305d23f9 req-db681014-2a1a-4730-94c5-91c2054ac1e5 tempest-AttachVolumeNegativeTest-2138445435 None] Deleting attachment b584e7d3-38e7-4bf0-a25a-bfa73b974566. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:29:23 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-502eb997-c30a-4f4f-b53e-659a40714418" returned: 0 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-quobyte-502eb997-c30a-4f4f-b53e-659a40714418" released by "delete_volume" :: held 1.975s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG cinder.quota [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Created reservations ['4e2a9cbf-d25a-48fc-83c8-2a082617a829', '8f474d6e-5c62-411f-92e6-cb29c7d7a303', 'b1d122bf-2718-4039-91e0-142c617c706b', '39a0a1de-b593-4525-81fb-7cc6b16ce139'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:23 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:23 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:24 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.998s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:24 devstack cinder-volume[94563]: DEBUG cinder.manager [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Deleted volume successfully.
Jun 26 00:29:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-a0215d67-4448-432c-914e-51a1aec28f98 req-fa23598f-c79d-43d6-856a-1e55f2955057 tempest-VolumesSnapshotsTestJSON-1328008095 None] Lock "cinder-502eb997-c30a-4f4f-b53e-659a40714418-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Flow 'volume_create_manager' (0181a897-5b8b-4431-94ad-96d816080c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0936adb3-223c-4344-b0d9-992e1d2f3d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0936adb3-223c-4344-b0d9-992e1d2f3d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-652843828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddbd5c0-3f1e-4f34-aee5-97302951c089,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47e3b23110304d19baf9814f600d7a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:30Z,use_quota=True,user_id='4199e7792702489a80bc0ec8f9fb087c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c509ada4-4ecf-4c38-841d-b1fff1b30269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c509ada4-4ecf-4c38-841d-b1fff1b30269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5e4a18-5307-4097-b5f5-d5dba027c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5e4a18-5307-4097-b5f5-d5dba027c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddbd5c0-3f1e-4f34-aee5-97302951c089', 'volume_name': 'volume-eddbd5c0-3f1e-4f34-aee5-97302951c089', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea41a8af-292d-4194-bf57-b8972696d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea41a8af-292d-4194-bf57-b8972696d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9d2371-2bbc-45d9-805f-6ba55b408ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:30 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Volume eddbd5c0-3f1e-4f34-aee5-97302951c089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddbd5c0-3f1e-4f34-aee5-97302951c089', 'volume_size': 1}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-652843828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddbd5c0-3f1e-4f34-aee5-97302951c089,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47e3b23110304d19baf9814f600d7a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:30Z,use_quota=True,user_id='4199e7792702489a80bc0ec8f9fb087c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Creating volume eddbd5c0-3f1e-4f34-aee5-97302951c089 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:30 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:30 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 1073741824
Jun 26 00:29:30 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:31 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 1073741824" returned: 0 in 1.112s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:31 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089
Jun 26 00:29:31 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:31 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089" returned: 0 in 0.738s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9d2371-2bbc-45d9-805f-6ba55b408ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddbd5c0-3f1e-4f34-aee5-97302951c089', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f838129b-868f-4a73-9613-6041bfee5f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:32 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Volume volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 (eddbd5c0-3f1e-4f34-aee5-97302951c089): created successfully
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f838129b-868f-4a73-9613-6041bfee5f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Flow 'volume_create_manager' (0181a897-5b8b-4431-94ad-96d816080c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-29101756-145c-4cdd-872e-b4ac818a5177 req-693f316a-57ae-4e75-8032-4ceac01b70e7 tempest-VolumesGetTestJSON-24087085 None] Created volume successfully.
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Acquiring lock "cinder-eddbd5c0-3f1e-4f34-aee5-97302951c089-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Lock "cinder-eddbd5c0-3f1e-4f34-aee5-97302951c089-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=68,cinder:UPDATE=65,cinder:INSERT=22,cinder:DELETE=7 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Acquiring lock "cinder-quobyte-eddbd5c0-3f1e-4f34-aee5-97302951c089" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Lock "cinder-quobyte-eddbd5c0-3f1e-4f34-aee5-97302951c089" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c0d8c-a35b-404c-86a3-3238d3bfb5c3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:33 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089
Jun 26 00:29:33 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "cinder-978df337-a600-4e18-aa28-642645d11741-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-978df337-a600-4e18-aa28-642645d11741-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "cinder-quobyte-978df337-a600-4e18-aa28-642645d11741" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-quobyte-978df337-a600-4e18-aa28-642645d11741" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:33 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2aab91-bfa8-4811-bfef-8e3be900a3e1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:33 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741
Jun 26 00:29:33 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:34 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089" returned: 0 in 1.129s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:34 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089
Jun 26 00:29:34 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:34 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741" returned: 0 in 0.946s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:34 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741
Jun 26 00:29:34 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:34 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-eddbd5c0-3f1e-4f34-aee5-97302951c089" returned: 0 in 0.786s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Lock "cinder-quobyte-eddbd5c0-3f1e-4f34-aee5-97302951c089" released by "delete_volume" :: held 1.983s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.quota [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Created reservations ['200826d6-4c60-4a22-809a-62dd94522db9', '4deb5ebd-8f36-476a-b9c4-45db93e852f4', 'c3f2d933-0ca2-4411-a848-edd0155ab17f', '56a305b5-62a4-47b2-b272-4627a33976ee'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:35 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:35 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:35 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Flow 'volume_create_manager' (d766662d-7521-4490-9f6e-6d6ec510dbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab97594-06ff-4dde-8c02-173565b9cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-978df337-a600-4e18-aa28-642645d11741" returned: 0 in 0.789s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab97594-06ff-4dde-8c02-173565b9cde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-607313677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc79682b-8338-419a-8ac0-b6331a748106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cefd2a1efe44ad9b4626d628a6ee3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:35Z,use_quota=True,user_id='ff01dd2a02cf40eb96e08fbcf6cc6333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd41729-ef20-4dd5-a629-6af9171bdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd41729-ef20-4dd5-a629-6af9171bdac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0721c962-9ff2-4bf6-9ac4-a07d21cafbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0721c962-9ff2-4bf6-9ac4-a07d21cafbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc79682b-8338-419a-8ac0-b6331a748106', 'volume_name': 'volume-fc79682b-8338-419a-8ac0-b6331a748106', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4148b463-f671-41f1-9fd8-cb3ae22e2251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4148b463-f671-41f1-9fd8-cb3ae22e2251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11db8747-d7f9-4e36-8265-fa491aaa64d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:35 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Volume fc79682b-8338-419a-8ac0-b6331a748106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc79682b-8338-419a-8ac0-b6331a748106', 'volume_size': 1}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-607313677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc79682b-8338-419a-8ac0-b6331a748106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cefd2a1efe44ad9b4626d628a6ee3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:35Z,use_quota=True,user_id='ff01dd2a02cf40eb96e08fbcf6cc6333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Creating volume fc79682b-8338-419a-8ac0-b6331a748106 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:35 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-quobyte-978df337-a600-4e18-aa28-642645d11741" released by "delete_volume" :: held 1.841s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:35 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106 1073741824
Jun 26 00:29:35 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Created reservations ['4e9a860f-45ac-4b96-b7a2-eb85b9578b87', 'f49a2630-5045-43a9-b150-62b44913fd9d', 'cccd4672-a203-4c3b-8a98-db9591081cb6', 'e83bf29b-5a20-470f-80ec-e9bd3cf49af9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:35 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:35 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "cinder-d63166b1-6d92-430f-85ca-97bb1610ed5a-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-d63166b1-6d92-430f-85ca-97bb1610ed5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "cinder-quobyte-d63166b1-6d92-430f-85ca-97bb1610ed5a" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-quobyte-d63166b1-6d92-430f-85ca-97bb1610ed5a" acquired by "delete_volume" :: waited 0.102s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:36 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.035s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG cinder.manager [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30f705f-9abc-49bf-a7b2-94cec9f71b7d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Deleted volume successfully.
Jun 26 00:29:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-53859d37-6648-4396-b23d-a3779cb87b12 req-385145f2-95fd-43be-8c22-a087d53ee3f4 tempest-VolumesGetTestJSON-24087085 None] Lock "cinder-eddbd5c0-3f1e-4f34-aee5-97302951c089-delete_volume" released by "delete_volume" :: held 3.732s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:36 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a
Jun 26 00:29:36 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:37 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106 1073741824" returned: 0 in 1.435s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:37 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.346s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Deleted volume successfully.
Jun 26 00:29:37 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106
Jun 26 00:29:37 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-61df9afe-7c2b-4ddb-b30b-8ebdfc03745d tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-978df337-a600-4e18-aa28-642645d11741-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:37 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a" returned: 0 in 1.234s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:37 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a
Jun 26 00:29:37 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:37 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106" returned: 0 in 0.879s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11db8747-d7f9-4e36-8265-fa491aaa64d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc79682b-8338-419a-8ac0-b6331a748106', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27922532-7731-4c2c-af3b-053ce12265cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Volume volume-fc79682b-8338-419a-8ac0-b6331a748106 (fc79682b-8338-419a-8ac0-b6331a748106): created successfully
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27922532-7731-4c2c-af3b-053ce12265cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Flow 'volume_create_manager' (d766662d-7521-4490-9f6e-6d6ec510dbca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:38 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b5f4bff3-52fd-4ede-bb1c-86adf7493039 tempest-VolumesTransfersTest-1602158870 None] Created volume successfully.
Jun 26 00:29:38 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d63166b1-6d92-430f-85ca-97bb1610ed5a" returned: 0 in 0.993s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-quobyte-d63166b1-6d92-430f-85ca-97bb1610ed5a" released by "delete_volume" :: held 2.353s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Created reservations ['b7341644-f1bd-43f7-8534-eb0e5c4cf4b6', '659567e2-ad1e-4f3f-9932-b176822ea0f1', '628ba941-9b90-4beb-8386-ee04449c6fee', '96d30712-9302-4ef3-8550-c90210de0ca8'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:38 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:38 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-570cea06-3a0e-487a-9e25-f274d6aa1901 tempest-VolumesTransfersTest-532958600 None] Transfer volume completed successfully.
Jun 26 00:29:39 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.850s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:39 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Deleted volume successfully.
Jun 26 00:29:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1a977476-3459-4146-8ba4-81f3fb4963f3 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-d63166b1-6d92-430f-85ca-97bb1610ed5a-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "cinder-9fcb34ee-fd62-4026-ad30-7cac8a78834c-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-9fcb34ee-fd62-4026-ad30-7cac8a78834c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "cinder-quobyte-9fcb34ee-fd62-4026-ad30-7cac8a78834c" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-quobyte-9fcb34ee-fd62-4026-ad30-7cac8a78834c" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacadad1-07a9-4226-b275-428c5782e885]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:40 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c
Jun 26 00:29:40 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Acquiring lock "cinder-fc79682b-8338-419a-8ac0-b6331a748106-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-fc79682b-8338-419a-8ac0-b6331a748106-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Acquiring lock "cinder-quobyte-fc79682b-8338-419a-8ac0-b6331a748106" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-quobyte-fc79682b-8338-419a-8ac0-b6331a748106" acquired by "delete_volume" :: waited 0.031s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c643b07-a40d-4131-b495-aa24f2a0113a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:41 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106
Jun 26 00:29:41 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:41 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c" returned: 0 in 1.121s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:41 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c
Jun 26 00:29:41 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Flow 'volume_create_manager' (842c5d08-9296-4bec-ba22-d95b0333be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c384680c-ee88-49ff-9aab-145b0c86cb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-da88f551-45f3-4d9e-aa9a-ec9403b86527 req-9cd0a850-735c-4bd3-ad16-fb8e03012958 tempest-TestShelveInstance-1224411811 None] Terminate volume connection completed successfully.
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-da88f551-45f3-4d9e-aa9a-ec9403b86527 req-9cd0a850-735c-4bd3-ad16-fb8e03012958 tempest-TestShelveInstance-1224411811 None] Deleting attachment 1727db97-2d92-4767-b78c-6badfd1586fb. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c384680c-ee88-49ff-9aab-145b0c86cb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1040325155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f4024a-c8ef-44b6-ad21-2af385554016,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9512e050a649bbbb37d9d8bcfc4ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:42Z,use_quota=True,user_id='827dcf3790bb4690ae81b6d7573097cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42ad4f4-3259-4116-8c6b-9df68be2e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42ad4f4-3259-4116-8c6b-9df68be2e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92436dc-6a1e-4324-abad-5d68e3d204f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92436dc-6a1e-4324-abad-5d68e3d204f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f4024a-c8ef-44b6-ad21-2af385554016', 'volume_name': 'volume-b7f4024a-c8ef-44b6-ad21-2af385554016', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35857a42-2de3-4790-8e08-c3dcf2fa351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35857a42-2de3-4790-8e08-c3dcf2fa351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4254af48-8ec8-43da-bd21-3c43bcb2407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:41 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Volume b7f4024a-c8ef-44b6-ad21-2af385554016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f4024a-c8ef-44b6-ad21-2af385554016', 'volume_size': 1}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1040325155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f4024a-c8ef-44b6-ad21-2af385554016,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9512e050a649bbbb37d9d8bcfc4ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:42Z,use_quota=True,user_id='827dcf3790bb4690ae81b6d7573097cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Creating volume b7f4024a-c8ef-44b6-ad21-2af385554016 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:41 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:41 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016 1073741824
Jun 26 00:29:41 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:42 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106" returned: 0 in 1.079s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:42 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9fcb34ee-fd62-4026-ad30-7cac8a78834c" returned: 0 in 0.830s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:42 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106
Jun 26 00:29:42 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-quobyte-9fcb34ee-fd62-4026-ad30-7cac8a78834c" released by "delete_volume" :: held 2.020s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Created reservations ['ea1523b3-81f5-4889-bb99-8dfd160c334c', '4d60dff7-d7bc-40df-8ac6-d9a094c3f9ac', '26aee706-3579-455f-8cba-e57c444f9949', '65a2de6a-b917-496a-b16f-5b0337ce0f4f'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:42 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:42 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:42 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016 1073741824" returned: 0 in 1.040s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:42 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016
Jun 26 00:29:42 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:42 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fc79682b-8338-419a-8ac0-b6331a748106" returned: 0 in 0.803s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-quobyte-fc79682b-8338-419a-8ac0-b6331a748106" released by "delete_volume" :: held 1.949s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Created reservations ['b52adc89-07d5-42e5-b495-7009f1f79795', '752632ed-03b1-425d-bf47-0d523d03e1b0', '3797cee2-8d82-4019-82e5-1531fc497ed9', 'f16bd1da-1a8d-44db-96e3-8b7c71599d9a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:43 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:43 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:43 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.895s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Deleted volume successfully.
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a121610c-3fea-4534-b280-d617b37caba1 tempest-AttachVolumeNegativeTest-2138445435 None] Lock "cinder-9fcb34ee-fd62-4026-ad30-7cac8a78834c-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:43 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016" returned: 0 in 0.808s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4254af48-8ec8-43da-bd21-3c43bcb2407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f4024a-c8ef-44b6-ad21-2af385554016', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ef4ff7-14a4-424b-8a3d-6324417f3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:43 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Volume volume-b7f4024a-c8ef-44b6-ad21-2af385554016 (b7f4024a-c8ef-44b6-ad21-2af385554016): created successfully
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ef4ff7-14a4-424b-8a3d-6324417f3356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Flow 'volume_create_manager' (842c5d08-9296-4bec-ba22-d95b0333be08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bf96824e-9677-43ab-8809-f8447cf6e3d7 tempest-VolumesTestJSON-1593884099 None] Created volume successfully.
Jun 26 00:29:43 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.762s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Deleted volume successfully.
Jun 26 00:29:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65178f9a-bcd4-4e1c-9c72-ad9b546e9f29 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-fc79682b-8338-419a-8ac0-b6331a748106-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Flow 'volume_create_manager' (571bf384-b2bc-43c4-96fb-007ef4b83776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd25f55-2b27-4058-ad06-368acd683845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd25f55-2b27-4058-ad06-368acd683845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-173354183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d991706-66fd-41c4-861e-aa05e0c97ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cefd2a1efe44ad9b4626d628a6ee3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:45Z,use_quota=True,user_id='ff01dd2a02cf40eb96e08fbcf6cc6333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6593a304-276b-499b-8c76-ad9068ba9b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6593a304-276b-499b-8c76-ad9068ba9b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7a08e8-54bd-419c-8bd9-fe1ead60c85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7a08e8-54bd-419c-8bd9-fe1ead60c85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d991706-66fd-41c4-861e-aa05e0c97ddf', 'volume_name': 'volume-8d991706-66fd-41c4-861e-aa05e0c97ddf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2714e4b-5463-4c62-b7af-0e8ff0b01598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2714e4b-5463-4c62-b7af-0e8ff0b01598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11329e3-1551-41e9-bddf-143f8763bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:44 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Volume 8d991706-66fd-41c4-861e-aa05e0c97ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d991706-66fd-41c4-861e-aa05e0c97ddf', 'volume_size': 1}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-173354183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d991706-66fd-41c4-861e-aa05e0c97ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cefd2a1efe44ad9b4626d628a6ee3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:45Z,use_quota=True,user_id='ff01dd2a02cf40eb96e08fbcf6cc6333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Creating volume 8d991706-66fd-41c4-861e-aa05e0c97ddf {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:44 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:44 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf 1073741824
Jun 26 00:29:44 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Flow 'volume_create_manager' (36e342a3-0bb7-411a-8894-6928170cb9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab91d338-c3c9-412b-8548-3ae02a4218ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab91d338-c3c9-412b-8548-3ae02a4218ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-285866222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9512e050a649bbbb37d9d8bcfc4ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:46Z,use_quota=True,user_id='827dcf3790bb4690ae81b6d7573097cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decf10a3-9c0c-47af-96ad-f1a56084b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decf10a3-9c0c-47af-96ad-f1a56084b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b820c6-523b-4ef5-b719-e9dde14318f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b820c6-523b-4ef5-b719-e9dde14318f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef', 'volume_name': 'volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638d362d-ae69-4074-aa9f-4a3feab59e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638d362d-ae69-4074-aa9f-4a3feab59e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba893c8-2fad-4b93-b168-08c9e1313523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:45 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Volume fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef', 'volume_size': 1}
Jun 26 00:29:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:46 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf 1073741824" returned: 0 in 1.139s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:46 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf
Jun 26 00:29:46 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:46 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf" returned: 0 in 0.769s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-285866222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9512e050a649bbbb37d9d8bcfc4ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:46Z,use_quota=True,user_id='827dcf3790bb4690ae81b6d7573097cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Creating volume fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:46 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11329e3-1551-41e9-bddf-143f8763bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d991706-66fd-41c4-861e-aa05e0c97ddf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:46 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef 1073741824
Jun 26 00:29:46 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06865d06-4096-403c-8ca0-c2534db86dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:46 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Volume volume-8d991706-66fd-41c4-861e-aa05e0c97ddf (8d991706-66fd-41c4-861e-aa05e0c97ddf): created successfully
Jun 26 00:29:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06865d06-4096-403c-8ca0-c2534db86dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Flow 'volume_create_manager' (571bf384-b2bc-43c4-96fb-007ef4b83776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:47 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-497bb486-91c2-4d8c-823d-ca138d69df22 tempest-VolumesTransfersTest-1602158870 None] Created volume successfully.
Jun 26 00:29:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:47 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef 1073741824" returned: 0 in 1.049s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:47 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=95,cinder:INSERT=29,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:29:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:48 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef
Jun 26 00:29:48 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Acquiring lock "cinder-8d991706-66fd-41c4-861e-aa05e0c97ddf-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-8d991706-66fd-41c4-861e-aa05e0c97ddf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Acquiring lock "cinder-quobyte-8d991706-66fd-41c4-861e-aa05e0c97ddf" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-quobyte-8d991706-66fd-41c4-861e-aa05e0c97ddf" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[69005b1b-d15a-4016-8a7d-d1adb4bd2a45]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:48 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf
Jun 26 00:29:48 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:48 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef" returned: 0 in 0.857s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.486s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba893c8-2fad-4b93-b168-08c9e1313523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14aec82-f02b-40f1-b01c-8ca25858ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[41834799-5b6c-46eb-9963-eab8fd783305]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:48 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Volume volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef (fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef): created successfully
Jun 26 00:29:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14aec82-f02b-40f1-b01c-8ca25858ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Flow 'volume_create_manager' (36e342a3-0bb7-411a-8894-6928170cb9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3c267dd5-3b57-4563-a65d-350c44840a74 tempest-VolumesTestJSON-1593884099 None] Created volume successfully.
Jun 26 00:29:49 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:29:49 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:49 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf" returned: 0 in 0.925s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:49 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf
Jun 26 00:29:49 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:49 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 0.916s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:49 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:29:49 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:50 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8d991706-66fd-41c4-861e-aa05e0c97ddf" returned: 0 in 0.780s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-quobyte-8d991706-66fd-41c4-861e-aa05e0c97ddf" released by "delete_volume" :: held 1.815s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Created reservations ['2f5eaf03-a1af-40fc-b853-943070e1dc1a', '91e565ca-7c56-4f86-b06f-0276150740ae', '7415c31a-1082-47e4-a5c8-5bb1a355f844', '42f7cf67-e67f-4caa-92a5-bcc5dc69ccc9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:50 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:50 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Flow 'volume_create_manager' (b3a55079-721f-4ed3-a9f6-4b75284f689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b839ad-81d8-447c-9673-18041cf4d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b839ad-81d8-447c-9673-18041cf4d23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1110352698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e8472e-bcb3-4bb9-a92b-5c0bf94074df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9512e050a649bbbb37d9d8bcfc4ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:51Z,use_quota=True,user_id='827dcf3790bb4690ae81b6d7573097cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3e6355-593e-4c3a-b189-eb1a1355aea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3e6355-593e-4c3a-b189-eb1a1355aea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ee89d6-2749-4d9c-942e-a0ed67839c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ee89d6-2749-4d9c-942e-a0ed67839c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e8472e-bcb3-4bb9-a92b-5c0bf94074df', 'volume_name': 'volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0932472-987a-4d7a-b663-82fbcfb375e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0932472-987a-4d7a-b663-82fbcfb375e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cb132a-92b0-456c-807d-e9c2219a5abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:50 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Volume e0e8472e-bcb3-4bb9-a92b-5c0bf94074df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df', 'volume_size': 1}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:50 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 1 in 1.058s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.036s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1110352698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e8472e-bcb3-4bb9-a92b-5c0bf94074df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9512e050a649bbbb37d9d8bcfc4ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:51Z,use_quota=True,user_id='827dcf3790bb4690ae81b6d7573097cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Creating volume e0e8472e-bcb3-4bb9-a92b-5c0bf94074df {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:50 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:50 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df 1073741824
Jun 26 00:29:50 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d869bf7-ffec-4816-9480-42fa3a26f49d', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:29:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-1d38e0c6-13aa-4f74-abfe-5a0b174ad09d req-4d338744-23fd-40fa-9636-c67fcad5feb4 tempest-TestShelveInstance-1224411811 None] attachment_update completed successfully.
Jun 26 00:29:51 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.953s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:51 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Deleted volume successfully.
Jun 26 00:29:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4f51415b-1162-4258-aa7a-9298cf477bf1 tempest-VolumesTransfersTest-2076718309 None] Lock "cinder-8d991706-66fd-41c4-861e-aa05e0c97ddf-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:52 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df 1073741824" returned: 0 in 1.261s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:52 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df
Jun 26 00:29:52 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bbead94d-9eb7-4204-845c-00887179ca44 tempest-GroupSnapshotsTest-1709639757 None] Group tempest-GroupSnapshotsTest-Group-904876307: creating
Jun 26 00:29:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bbead94d-9eb7-4204-845c-00887179ca44 tempest-GroupSnapshotsTest-1709639757 None] Group tempest-GroupSnapshotsTest-Group-904876307: created successfully
Jun 26 00:29:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bbead94d-9eb7-4204-845c-00887179ca44 tempest-GroupSnapshotsTest-1709639757 None] Create group completed successfully.
Jun 26 00:29:52 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df" returned: 0 in 0.786s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cb132a-92b0-456c-807d-e9c2219a5abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6724a5-230b-472e-87d4-6bddc47a3c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:53 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Volume volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df (e0e8472e-bcb3-4bb9-a92b-5c0bf94074df): created successfully
Jun 26 00:29:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6724a5-230b-472e-87d4-6bddc47a3c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Flow 'volume_create_manager' (b3a55079-721f-4ed3-a9f6-4b75284f689c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a5d9ddb0-c22b-4407-8d85-327804f59407 tempest-VolumesTestJSON-1593884099 None] Created volume successfully.
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (4326a867-b333-4163-8945-abad74f1bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c823f981-6020-4e79-a9a0-9d256336bc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c823f981-6020-4e79-a9a0-9d256336bc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-185341616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1503e3d6-e238-4b76-99de-87cdbeace92c,host='devstack@QuobyteHD#QuobyteHD',id=184fa72c-fa8f-4d84-907c-59df02e1ef37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:54Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8cc4dd-ea20-4c40-a067-17c45955fe39),volume_type_id=0c8cc4dd-ea20-4c40-a067-17c45955fe39)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7098bbb7-0657-49ad-9027-5ffeb25c9b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7098bbb7-0657-49ad-9027-5ffeb25c9b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0344e337-ab36-477c-abdc-0c620f8c2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0344e337-ab36-477c-abdc-0c620f8c2410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184fa72c-fa8f-4d84-907c-59df02e1ef37', 'volume_name': 'volume-184fa72c-fa8f-4d84-907c-59df02e1ef37', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1185fa9f-203f-4b0f-a589-c2618490b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1185fa9f-203f-4b0f-a589-c2618490b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68913129-0525-4e3b-a08d-fe196672c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:54 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Volume 184fa72c-fa8f-4d84-907c-59df02e1ef37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184fa72c-fa8f-4d84-907c-59df02e1ef37', 'volume_size': 1}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1503e3d6-e238-4b76-99de-87cdbeace92c,created_at=2026-06-25T22:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-185341616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1503e3d6-e238-4b76-99de-87cdbeace92c,host='devstack@QuobyteHD#QuobyteHD',id=184fa72c-fa8f-4d84-907c-59df02e1ef37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:29:54Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8cc4dd-ea20-4c40-a067-17c45955fe39),volume_type_id=0c8cc4dd-ea20-4c40-a067-17c45955fe39)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Creating volume 184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:29:54 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:29:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:54 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 1073741824
Jun 26 00:29:54 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Acquiring lock "cinder-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Lock "cinder-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Acquiring lock "cinder-quobyte-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Lock "cinder-quobyte-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50eb8ce-9ae2-461b-97ab-45f7a55bc16a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:55 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df
Jun 26 00:29:55 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:55 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 1073741824" returned: 0 in 1.085s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:55 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:29:55 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:56 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df" returned: 0 in 0.978s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:56 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df
Jun 26 00:29:56 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:56 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 0.761s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68913129-0525-4e3b-a08d-fe196672c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184fa72c-fa8f-4d84-907c-59df02e1ef37', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8570dd-e221-4dde-a49c-9d7755ca9e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:29:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Volume volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 (184fa72c-fa8f-4d84-907c-59df02e1ef37): created successfully
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8570dd-e221-4dde-a49c-9d7755ca9e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:29:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (4326a867-b333-4163-8945-abad74f1bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:29:56 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e7b59dbe-87b6-4839-8a6e-e7b3616d16fd tempest-GroupSnapshotsTest-1709639757 None] Created volume successfully.
Jun 26 00:29:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] GroupSnapshot 9b793bd7-12ea-4cf3-96c8-855d35d1183e: creating.
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Group snapshot 9b793bd7-12ea-4cf3-96c8-855d35d1183e: creating. {{(pid=94563) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Creating offline snapshot 5ee10890-1e1b-41e5-b20a-afc00d023924 of volume 184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:29:57 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df" returned: 0 in 0.965s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe7fad-aa80-4d8e-8c6c-93545c7e9d08]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Lock "cinder-quobyte-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df" released by "delete_volume" :: held 2.024s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Created reservations ['7403dc4c-18a7-494b-b33f-048ad6745106', '9d247ad7-540d-4b75-b934-3c5595e3f665', 'a58dfab6-1456-4eef-955c-bab10f5920f7', '6662bf0f-0841-4e61-8f5e-eeb4c4172bb6'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:29:57 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:29:57 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:29:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:57 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:29:57 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:58 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 1.009s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:58 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 1G
Jun 26 00:29:58 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:58 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.879s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:29:58 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Deleted volume successfully.
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ebb3e2a4-afd2-4d5a-b4ae-34d4e78a584d tempest-VolumesTestJSON-1593884099 None] Lock "cinder-e0e8472e-bcb3-4bb9-a92b-5c0bf94074df-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "cinder-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Lock "cinder-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "cinder-quobyte-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Lock "cinder-quobyte-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d20c54-6b69-4b45-8a00-abfe36bcd367]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:29:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:58 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef
Jun 26 00:29:58 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:59 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 1G" returned: 0 in 1.021s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:59 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924
Jun 26 00:29:59 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:29:59 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Jun 26 00:29:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef" returned: 0 in 0.927s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:29:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:29:59 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef
Jun 26 00:29:59 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:00 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924" returned: 0 in 1.039s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:00 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:00 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924
Jun 26 00:30:00 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:00 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef" returned: 0 in 1.004s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Lock "cinder-quobyte-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef" released by "delete_volume" :: held 1.983s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Created reservations ['da47bc88-a9dc-47fa-85ca-e4d678a47c1c', '03c011fd-49b8-4129-ab76-1334a39f7e6a', '336f2eea-57a6-4c07-9074-427fd0f58453', '597eb5cf-8ec2-4833-8e24-4862fd8903fa'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:00 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:00 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:01 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:01 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Acquiring lock "cinder-b7f4024a-c8ef-44b6-ad21-2af385554016-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Lock "cinder-b7f4024a-c8ef-44b6-ad21-2af385554016-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Acquiring lock "cinder-quobyte-b7f4024a-c8ef-44b6-ad21-2af385554016" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:01 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924" returned: 0 in 0.866s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Lock "cinder-quobyte-b7f4024a-c8ef-44b6-ad21-2af385554016" acquired by "delete_volume" :: waited 0.048s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88e6afa-e865-4a2e-9249-235b9ca52e24]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:01 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info
Jun 26 00:30:01 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:01 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016
Jun 26 00:30:01 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:01 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.942s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Deleted volume successfully.
Jun 26 00:30:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-818a7061-5654-46c1-b24a-158554b266b9 tempest-VolumesTestJSON-1593884099 None] Lock "cinder-fa5aaa4c-6e86-4b01-b8b5-73a956ec23ef-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:02 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.144s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:30:02 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016" returned: 0 in 0.939s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:02 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016
Jun 26 00:30:02 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:02 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info" returned: 0 in 1.011s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:02 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:02 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info
Jun 26 00:30:02 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:03 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b7f4024a-c8ef-44b6-ad21-2af385554016" returned: 0 in 1.112s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Lock "cinder-quobyte-b7f4024a-c8ef-44b6-ad21-2af385554016" released by "delete_volume" :: held 2.124s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:03 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.info" returned: 0 in 1.061s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.208s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Created reservations ['0eb1b216-35ad-4f17-8d2c-bb00bba6473d', '0321da59-af78-4654-bf62-198eaf294bff', '2044a784-6e65-43aa-ae3a-236721febf3e', 'd21adacc-9364-403f-a936-c912648577ec'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b9cd38ae-269f-4136-8211-9aa71e5f92a7 tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 9b793bd7-12ea-4cf3-96c8-855d35d1183e: created successfully
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:03 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:03 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:05 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.567s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Deleted volume successfully.
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-737613c1-58e1-428e-9b0f-3264f73efefd tempest-VolumesTestJSON-1593884099 None] Lock "cinder-b7f4024a-c8ef-44b6-ad21-2af385554016-delete_volume" released by "delete_volume" :: held 4.310s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-5ee10890-1e1b-41e5-b20a-afc00d023924-e6fa8524-6243-4c0b-9147-fd809d0aaec1" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-5ee10890-1e1b-41e5-b20a-afc00d023924-e6fa8524-6243-4c0b-9147-fd809d0aaec1" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Creating volume e6fa8524-6243-4c0b-9147-fd809d0aaec1 from snapshot 5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-e6fa8524-6243-4c0b-9147-fd809d0aaec1" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e6fa8524-6243-4c0b-9147-fd809d0aaec1" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] snapshot: 5ee10890-1e1b-41e5-b20a-afc00d023924, volume: e6fa8524-6243-4c0b-9147-fd809d0aaec1,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a743ba-3fef-4ee7-9f6c-f3aeae06910f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:06 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924
Jun 26 00:30:06 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:07 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924" returned: 0 in 1.368s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184fa72c-fa8f-4d84-907c-59df02e1ef37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:30:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:30:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:30:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2990020e-cda7-4b0a-acab-12990b12c112]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:07 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:30:07 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:08 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 1.330s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:08 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:30:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:08 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1
Jun 26 00:30:08 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Flow 'volume_create_manager' (9cbe944b-d144-4d4e-94eb-6e5cd3d799b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a109a169-95ff-4b58-9e3c-a0d4dec0fab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a109a169-95ff-4b58-9e3c-a0d4dec0fab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-676481196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8444240a-fd7f-4e23-9fd2-d6bc72a19103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4552c5b77f451db1943e13597511eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:14Z,use_quota=True,user_id='73f4b3afb49e45c48871de71e5ad8ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971073a3-da4c-4c42-9a71-0d0e29c7bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971073a3-da4c-4c42-9a71-0d0e29c7bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743824ab-8c7d-430b-add2-63d9e275bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743824ab-8c7d-430b-add2-63d9e275bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8444240a-fd7f-4e23-9fd2-d6bc72a19103', 'volume_name': 'volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fd2bcb-501f-4fc6-bdb9-5e5f9dc7276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fd2bcb-501f-4fc6-bdb9-5e5f9dc7276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88adc4ea-88f4-4210-ab72-c5a604c96a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Volume 8444240a-fd7f-4e23-9fd2-d6bc72a19103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103', 'volume_size': 1}
Jun 26 00:30:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1" returned: 0 in 8.032s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0854fc7-3565-4f8d-b6c9-fdc08ef0acfc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3830aaf5-9c53-40d0-b55f-73898ca35caf tempest-GroupsV314Test-1033260792 None] Group tempest-GroupsV314Test-Group-758557958: creating
Jun 26 00:30:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3830aaf5-9c53-40d0-b55f-73898ca35caf tempest-GroupsV314Test-1033260792 None] Group tempest-GroupsV314Test-Group-758557958: created successfully
Jun 26 00:30:16 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:30:16 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3830aaf5-9c53-40d0-b55f-73898ca35caf tempest-GroupsV314Test-1033260792 None] Create group completed successfully.
Jun 26 00:30:17 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 0.981s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:17 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37, size 1024.00 MB, duration 8.03 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:30:17 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Converted 1024.00 MB image at 127.48 MB/s
Jun 26 00:30:17 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:17 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1
Jun 26 00:30:17 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:18 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1" returned: 0 in 0.710s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e6fa8524-6243-4c0b-9147-fd809d0aaec1" released by "_copy_volume_from_snapshot" :: held 12.627s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-5ee10890-1e1b-41e5-b20a-afc00d023924-e6fa8524-6243-4c0b-9147-fd809d0aaec1" released by "_create_volume_from_snapshot" :: held 12.686s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.711s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.618s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-676481196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8444240a-fd7f-4e23-9fd2-d6bc72a19103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4552c5b77f451db1943e13597511eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:14Z,use_quota=True,user_id='73f4b3afb49e45c48871de71e5ad8ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Creating volume 8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:30:18 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:18 devstack sudo[107127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 1073741824
Jun 26 00:30:18 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Flow 'volume_create_manager' (bb32dba3-68b1-47d0-ab6a-87e53a2fed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12629c7f-84ac-4d62-8765-3be2cbddaec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12629c7f-84ac-4d62-8765-3be2cbddaec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611549355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed46eba8-6a83-4b69-957c-db215dd0ef3a,host='devstack@QuobyteHD#QuobyteHD',id=0383ee98-6abd-4575-ab10-c3f123d1d686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866688ed99e148d187ddcaaa058e52e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:19Z,use_quota=True,user_id='bef45e7b331347e9bc0814352ae335a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db9a53ca-01d0-420a-9367-5ab4c7fd57a2),volume_type_id=db9a53ca-01d0-420a-9367-5ab4c7fd57a2)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f87493-4475-440c-b152-fa2e4e929ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f87493-4475-440c-b152-fa2e4e929ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7108bf-f07b-42f1-ab46-b0ad2b7bc5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7108bf-f07b-42f1-ab46-b0ad2b7bc5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0383ee98-6abd-4575-ab10-c3f123d1d686', 'volume_name': 'volume-0383ee98-6abd-4575-ab10-c3f123d1d686', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5103b8c8-63b7-46a8-850f-9acf3343f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5103b8c8-63b7-46a8-850f-9acf3343f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e440123b-dd65-40d4-92e0-2c7ecc13831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:18 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Volume 0383ee98-6abd-4575-ab10-c3f123d1d686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0383ee98-6abd-4575-ab10-c3f123d1d686', 'volume_size': 1}
Jun 26 00:30:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-baad06b7-e423-43a3-8df8-606e84ee7bd1 tempest-GroupSnapshotsTest-1709639757 None] Create group from source-snapshot-9b793bd7-12ea-4cf3-96c8-855d35d1183e completed successfully.
Jun 26 00:30:19 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 1073741824" returned: 0 in 0.943s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:19 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:30:19 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-e6fa8524-6243-4c0b-9147-fd809d0aaec1" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e6fa8524-6243-4c0b-9147-fd809d0aaec1" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6335bc-da25-46c1-8e39-ad380c903e9e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:20 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 0.774s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed46eba8-6a83-4b69-957c-db215dd0ef3a,created_at=2026-06-25T22:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611549355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed46eba8-6a83-4b69-957c-db215dd0ef3a,host='devstack@QuobyteHD#QuobyteHD',id=0383ee98-6abd-4575-ab10-c3f123d1d686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866688ed99e148d187ddcaaa058e52e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:19Z,use_quota=True,user_id='bef45e7b331347e9bc0814352ae335a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db9a53ca-01d0-420a-9367-5ab4c7fd57a2),volume_type_id=db9a53ca-01d0-420a-9367-5ab4c7fd57a2)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Creating volume 0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:30:20 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88adc4ea-88f4-4210-ab72-c5a604c96a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:20 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1
Jun 26 00:30:20 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f116ba-f0a2-4111-9948-0fd5451a84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:20 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 1073741824
Jun 26 00:30:20 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:20 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Volume volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 (8444240a-fd7f-4e23-9fd2-d6bc72a19103): created successfully
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f116ba-f0a2-4111-9948-0fd5451a84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Flow 'volume_create_manager' (9cbe944b-d144-4d4e-94eb-6e5cd3d799b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:20 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a704e5e5-d68f-4fda-9b4b-8337ea42ccce tempest-VolumesActionsTest-1755753613 None] Created volume successfully.
Jun 26 00:30:21 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1" returned: 0 in 0.971s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:21 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1
Jun 26 00:30:21 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:21 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 1073741824" returned: 0 in 1.009s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:21 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:21 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:22 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:22 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 0.757s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e6fa8524-6243-4c0b-9147-fd809d0aaec1" returned: 0 in 0.968s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e6fa8524-6243-4c0b-9147-fd809d0aaec1" released by "delete_volume" :: held 2.016s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e440123b-dd65-40d4-92e0-2c7ecc13831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0383ee98-6abd-4575-ab10-c3f123d1d686', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb30f039-4909-4b4e-8944-a37363235610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:22 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Volume volume-0383ee98-6abd-4575-ab10-c3f123d1d686 (0383ee98-6abd-4575-ab10-c3f123d1d686): created successfully
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb30f039-4909-4b4e-8944-a37363235610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Flow 'volume_create_manager' (bb32dba3-68b1-47d0-ab6a-87e53a2fed3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bc2e3d04-6816-4860-898a-b9f5bd4900a8 tempest-GroupsV314Test-1033260792 None] Created volume successfully.
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['c725e4ce-c204-4a86-b403-668a36372e96'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:22 devstack cinder-volume[94563]: WARNING cinder.quota [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1904159381 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1904159381, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:30:22 devstack cinder-volume[94563]: WARNING cinder.quota [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1904159381 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1904159381, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['363ffd68-2336-435d-aa78-6244329ebe5d', '446b57f7-e077-43cf-a68c-81f2c2122ac4', '332af2d5-5da8-4c00-a608-e449e7f54bf1', '1c061ca8-6bba-4c72-900c-b47fb809d090'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:22 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:22 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 9b793bd7-12ea-4cf3-96c8-855d35d1183e: deleting
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 9b793bd7-12ea-4cf3-96c8-855d35d1183e: deleting {{(pid=94563) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-184fa72c-fa8f-4d84-907c-59df02e1ef37" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-184fa72c-fa8f-4d84-907c-59df02e1ef37" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-5ee10890-1e1b-41e5-b20a-afc00d023924" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-5ee10890-1e1b-41e5-b20a-afc00d023924" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Deleting offline snapshot 5ee10890-1e1b-41e5-b20a-afc00d023924 of volume 184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] snapshot_file for this snap is: volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee28d9d5-8a04-4184-a97c-b1d1bf26b433]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:23 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924
Jun 26 00:30:23 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:23 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.248s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:23 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:23 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f1db090d-ab15-48b2-ad40-061ad7f36ba5 tempest-GroupSnapshotsTest-1709639757 None] Delete group completed successfully.
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:24 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Cloning volume 0383ee98-6abd-4575-ab10-c3f123d1d686 to volume 41656767-1f40-4584-9277-d30ed5939dbe
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Creating offline snapshot 40ee065f-bab4-4baf-8125-bb3db8542ced of volume 0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd338646-b149-4e87-a89d-8a08625cd465]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:24 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924" returned: 0 in 1.132s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184fa72c-fa8f-4d84-907c-59df02e1ef37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:30:24 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:24 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c546a8-fa8e-43a3-b949-6cf70b577c2e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:24 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:30:24 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:24 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 0.809s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:24 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced 1G
Jun 26 00:30:24 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:25 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 0.784s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:25 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924
Jun 26 00:30:25 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:25 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced 1G" returned: 0 in 0.864s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0383ee98-6abd-4575-ab10-c3f123d1d686 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:25 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0383ee98-6abd-4575-ab10-c3f123d1d686 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced
Jun 26 00:30:25 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:25 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924" returned: 0 in 0.816s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:25 devstack sudo[107256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924
Jun 26 00:30:25 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:26 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0383ee98-6abd-4575-ab10-c3f123d1d686 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced" returned: 0 in 0.692s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:26 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:26 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced
Jun 26 00:30:26 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:26 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37.5ee10890-1e1b-41e5-b20a-afc00d023924" returned: 0 in 0.675s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-5ee10890-1e1b-41e5-b20a-afc00d023924" released by "_delete_snapshot" :: held 3.571s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-184fa72c-fa8f-4d84-907c-59df02e1ef37" released by "delete_snapshot" :: held 3.639s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:26 devstack cinder-volume[94563]: WARNING cinder.quota [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1904159381 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1904159381, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:30:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['c655d164-e610-458a-9c5e-493c4dd101f8', 'fd603b1c-8dec-47aa-a3ed-3ad48e409741', '945c1605-e0e4-45e5-bbf7-0f21f946f9c6', 'cd24fa1c-7754-4694-9656-75249059f362'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8cb15360-ca8a-463f-b1a8-cc6c998d9d5a tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 9b793bd7-12ea-4cf3-96c8-855d35d1183e: deleted successfully
Jun 26 00:30:27 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced" returned: 0 in 0.660s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:27 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info
Jun 26 00:30:27 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-184fa72c-fa8f-4d84-907c-59df02e1ef37" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-184fa72c-fa8f-4d84-907c-59df02e1ef37" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b39ec4b-b549-415e-ab3b-95752c05443e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:28 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info" returned: 0 in 0.954s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:28 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:28 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:30:28 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:28 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info
Jun 26 00:30:28 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:28 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.info" returned: 0 in 0.760s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Acquiring lock "cinder-quobyte-41656767-1f40-4584-9277-d30ed5939dbe" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:28 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 0.975s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-41656767-1f40-4584-9277-d30ed5939dbe" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] snapshot: 40ee065f-bab4-4baf-8125-bb3db8542ced, volume: 41656767-1f40-4584-9277-d30ed5939dbe,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:30:28 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37
Jun 26 00:30:28 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[efae512c-b307-4cea-9041-a4225acd3633]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:29 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced
Jun 26 00:30:29 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:29 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-184fa72c-fa8f-4d84-907c-59df02e1ef37" returned: 0 in 0.796s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-184fa72c-fa8f-4d84-907c-59df02e1ef37" released by "delete_volume" :: held 1.873s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['030e4b0b-0562-4730-b28e-bfcdff0ee0de'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:29 devstack cinder-volume[94563]: WARNING cinder.db.api [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1904159381']
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['c4d61d05-f5c0-4487-bdea-6dc76820711b', 'a5fd6d79-68b0-43a0-baba-3ddceed14cfe', '3939fe0b-948e-44db-99e8-e99467a89603', '2a1af5ed-6792-468a-8ddc-830f734d71aa'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:29 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced" returned: 0 in 0.936s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0383ee98-6abd-4575-ab10-c3f123d1d686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd94159-c669-40cb-861d-2c568ffc1f8b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:30 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:30 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:30 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:30 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:30 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.686s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:30 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ce93c956-6334-4b73-a08e-61417fe88dcd tempest-GroupSnapshotsTest-1709639757 None] Delete group completed successfully.
Jun 26 00:30:30 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 0.902s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:30 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:30:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:30 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe
Jun 26 00:30:30 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-36beaaa0-c626-4be7-94a0-e1cc5edacf4a tempest-GroupSnapshotsTest-1709639757 None] Group tempest-GroupSnapshotsTest-Group-249023912: creating
Jun 26 00:30:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-36beaaa0-c626-4be7-94a0-e1cc5edacf4a tempest-GroupSnapshotsTest-1709639757 None] Group tempest-GroupSnapshotsTest-Group-249023912: created successfully
Jun 26 00:30:31 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-36beaaa0-c626-4be7-94a0-e1cc5edacf4a tempest-GroupSnapshotsTest-1709639757 None] Create group completed successfully.
Jun 26 00:30:33 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=102,cinder:INSERT=32,cinder:UPDATE=144,cinder:DELETE=8 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:30:33 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (cdc78b84-aa66-41a2-964c-7b0baf66667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a4a903-9046-4380-9710-a3d969fb1718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a4a903-9046-4380-9710-a3d969fb1718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-486852038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=19822ea0-63d8-43ac-a192-9dcaf4d699f1,host='devstack@QuobyteHD#QuobyteHD',id=e1d6c967-949b-448f-9d1a-196bcd8c5791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:34Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a14f401-03e0-499a-b315-4f5d37a42728),volume_type_id=5a14f401-03e0-499a-b315-4f5d37a42728)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f93803-c45c-4c7b-a32a-abdedf6eff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f93803-c45c-4c7b-a32a-abdedf6eff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30d4fa0-6140-4a50-9b69-5a896c101a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30d4fa0-6140-4a50-9b69-5a896c101a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d6c967-949b-448f-9d1a-196bcd8c5791', 'volume_name': 'volume-e1d6c967-949b-448f-9d1a-196bcd8c5791', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2488e08d-d0a1-472e-8eeb-df5d34bb90b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2488e08d-d0a1-472e-8eeb-df5d34bb90b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890708c-7ee6-454f-89cc-7ecdb008e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Volume e1d6c967-949b-448f-9d1a-196bcd8c5791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d6c967-949b-448f-9d1a-196bcd8c5791', 'volume_size': 1}
Jun 26 00:30:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:37 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe" returned: 0 in 6.855s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff95eb1-7e81-4ffc-84fc-bb043383a1e2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:38 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:38 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:39 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 1.787s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:39 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:30:39 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Converted 1024.00 MB image at 149.36 MB/s
Jun 26 00:30:39 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:39 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe
Jun 26 00:30:39 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:40 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe" returned: 0 in 1.052s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-41656767-1f40-4584-9277-d30ed5939dbe" released by "_copy_volume_from_snapshot" :: held 11.664s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Acquiring lock "cinder-quobyte-40ee065f-bab4-4baf-8125-bb3db8542ced" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-40ee065f-bab4-4baf-8125-bb3db8542ced" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Deleting offline snapshot 40ee065f-bab4-4baf-8125-bb3db8542ced of volume 0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] snapshot_file for this snap is: volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fccdb-1d4f-4392-a706-534a401d2a5d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:40 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced
Jun 26 00:30:40 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0b2396c5-3e65-4aec-8df6-2f032a12538a tempest-VolumesActionsTest-1755753613 None] Acquiring lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103" by "attach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0b2396c5-3e65-4aec-8df6-2f032a12538a tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103" acquired by "attach_volume" :: waited 0.061s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0b2396c5-3e65-4aec-8df6-2f032a12538a tempest-VolumesActionsTest-1755753613 None] Attaching volume 8444240a-fd7f-4e23-9fd2-d6bc72a19103 to instance 695614e7-b888-45f4-9a05-f9235dd04097 at mountpoint /dev/vdb on host None.
Jun 26 00:30:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0b2396c5-3e65-4aec-8df6-2f032a12538a tempest-VolumesActionsTest-1755753613 None] Attach volume completed successfully.
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0b2396c5-3e65-4aec-8df6-2f032a12538a tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103" released by "attach_volume" :: held 0.247s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-67573802-316a-4f23-8bf0-14bce7933acb tempest-VolumesActionsTest-1755753613 None] Acquiring lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-detach_volume" by "detach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-67573802-316a-4f23-8bf0-14bce7933acb tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-67573802-316a-4f23-8bf0-14bce7933acb tempest-VolumesActionsTest-1755753613 None] Detaching volume 8444240a-fd7f-4e23-9fd2-d6bc72a19103 from instance 695614e7-b888-45f4-9a05-f9235dd04097.
Jun 26 00:30:41 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced" returned: 0 in 1.170s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0383ee98-6abd-4575-ab10-c3f123d1d686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:30:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-67573802-316a-4f23-8bf0-14bce7933acb tempest-VolumesActionsTest-1755753613 None] Detach volume completed successfully.
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[59902220-d3e4-4224-a9a6-b24446574430]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-67573802-316a-4f23-8bf0-14bce7933acb tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:41 devstack sudo[107473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:41 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-fc263957-2f40-4f73-a095-750a4169f9bf req-d9ef0582-b1d9-41d5-a758-8b6ca4469259 tempest-TestShelveInstance-1224411811 None] Terminate volume connection completed successfully.
Jun 26 00:30:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-fc263957-2f40-4f73-a095-750a4169f9bf req-d9ef0582-b1d9-41d5-a758-8b6ca4469259 tempest-TestShelveInstance-1224411811 None] Deleting attachment 1d869bf7-ffec-4816-9480-42fa3a26f49d. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:30:42 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 0.844s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:42 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced
Jun 26 00:30:42 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Acquiring lock "cinder-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Lock "cinder-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Acquiring lock "cinder-quobyte-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Lock "cinder-quobyte-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:43 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7488de3-2af4-46f1-9d81-a18d232484c5]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:43 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:30:43 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:43 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced" returned: 0 in 0.915s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:43 devstack sudo[107492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced
Jun 26 00:30:43 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:44 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 1.083s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:44 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:30:44 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:44 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686.40ee065f-bab4-4baf-8125-bb3db8542ced" returned: 0 in 0.965s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-40ee065f-bab4-4baf-8125-bb3db8542ced" released by "_delete_snapshot" :: held 4.043s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.670s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.558s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=19822ea0-63d8-43ac-a192-9dcaf4d699f1,created_at=2026-06-25T22:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-486852038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=19822ea0-63d8-43ac-a192-9dcaf4d699f1,host='devstack@QuobyteHD#QuobyteHD',id=e1d6c967-949b-448f-9d1a-196bcd8c5791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:34Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a14f401-03e0-499a-b315-4f5d37a42728),volume_type_id=5a14f401-03e0-499a-b315-4f5d37a42728)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Creating volume e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:30:44 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:30:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:44 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 1073741824
Jun 26 00:30:44 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:44 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3efabee2-7201-42b7-a5ac-38203cab2328 tempest-GroupsV314Test-1033260792 None] Create group from source-group-ed46eba8-6a83-4b69-957c-db215dd0ef3a completed successfully.
Jun 26 00:30:45 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 1 in 0.953s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:30:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:45 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809
Jun 26 00:30:45 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:45 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 1073741824" returned: 0 in 1.270s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Acquiring lock "cinder-quobyte-41656767-1f40-4584-9277-d30ed5939dbe" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:46 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" returned: 0 in 0.992s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:46 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791
Jun 26 00:30:46 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-41656767-1f40-4584-9277-d30ed5939dbe" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Lock "cinder-quobyte-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809" released by "delete_volume" :: held 3.144s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d1d28-bc4d-4b4e-8ceb-231a5df83760]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.quota [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Created reservations ['4b163868-6af2-43a6-af34-e6457406f5ba', '9d284352-3c28-4ee9-b27a-34355b64ad66', '4b7e7ca7-1bed-4a5d-9570-adace6c3c521', 'e4f17862-a44e-4c5e-bb16-ae2dc396b074'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:46 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe
Jun 26 00:30:46 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:46 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:46 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:46 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791" returned: 0 in 0.937s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890708c-7ee6-454f-89cc-7ecdb008e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d6c967-949b-448f-9d1a-196bcd8c5791', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9050bc7c-c52e-463e-ae7c-5bdccd4f1ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:47 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Volume volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 (e1d6c967-949b-448f-9d1a-196bcd8c5791): created successfully
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9050bc7c-c52e-463e-ae7c-5bdccd4f1ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (cdc78b84-aa66-41a2-964c-7b0baf66667d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:47 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5aafcd4d-6d05-4dd5-af90-66a2cebcac83 tempest-GroupSnapshotsTest-1709639757 None] Created volume successfully.
Jun 26 00:30:47 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.833s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG cinder.manager [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:47 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Deleted volume successfully.
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [req-fc263957-2f40-4f73-a095-750a4169f9bf req-e7624667-1b59-4933-af33-888e2b2dc5cd tempest-TestShelveInstance-1224411811 None] Lock "cinder-7abc6dbe-3bce-4f09-a3a0-e5ebddc2f809-delete_volume" released by "delete_volume" :: held 4.366s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:47 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe" returned: 0 in 1.165s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:47 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe
Jun 26 00:30:47 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=99,cinder:UPDATE=95,cinder:INSERT=22,cinder:DELETE=4 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (03c98f89-cc7e-4fad-a827-f0e18337d98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaf980b-008c-44c0-9d99-8eac01500b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaf980b-008c-44c0-9d99-8eac01500b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566344623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=19822ea0-63d8-43ac-a192-9dcaf4d699f1,host='devstack@QuobyteHD#QuobyteHD',id=cf6a4ea7-2272-4490-ab60-e1276ef8d31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:48Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a14f401-03e0-499a-b315-4f5d37a42728),volume_type_id=5a14f401-03e0-499a-b315-4f5d37a42728)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff184968-6ea7-47fc-87b8-efe7668ed9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff184968-6ea7-47fc-87b8-efe7668ed9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70abf59e-d196-465d-b2ae-6c1e338830be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70abf59e-d196-465d-b2ae-6c1e338830be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6a4ea7-2272-4490-ab60-e1276ef8d31f', 'volume_name': 'volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf666f8-0985-48e2-8091-d5124e86bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf666f8-0985-48e2-8091-d5124e86bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65dea3b8-b7f8-4f48-9c62-a344e74d5738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:48 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Volume cf6a4ea7-2272-4490-ab60-e1276ef8d31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f', 'volume_size': 1}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=19822ea0-63d8-43ac-a192-9dcaf4d699f1,created_at=2026-06-25T22:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566344623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=19822ea0-63d8-43ac-a192-9dcaf4d699f1,host='devstack@QuobyteHD#QuobyteHD',id=cf6a4ea7-2272-4490-ab60-e1276ef8d31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:30:48Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a14f401-03e0-499a-b315-4f5d37a42728),volume_type_id=5a14f401-03e0-499a-b315-4f5d37a42728)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Creating volume cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:30:48 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:48 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f 1073741824
Jun 26 00:30:48 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:48 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-41656767-1f40-4584-9277-d30ed5939dbe" returned: 0 in 0.877s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-41656767-1f40-4584-9277-d30ed5939dbe" released by "delete_volume" :: held 2.123s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Created reservations ['9270ac7a-9cd0-41d5-b21a-4e9b9f65abcc'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:48 devstack cinder-volume[94563]: WARNING cinder.quota [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1152002704 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1152002704, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:30:48 devstack cinder-volume[94563]: WARNING cinder.quota [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1152002704 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1152002704, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Created reservations ['6c7c2983-7ad2-420b-976d-4c138b28227f', 'bb96063e-8455-486f-8b56-3ea4bec25a51', '2528fdd7-54a6-43da-8e76-64a348ce27f3', '1837fb76-5583-462e-a24f-8d8f35fc56a9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:48 devstack sudo[107566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:48 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:49 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f 1073741824" returned: 0 in 1.012s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:49 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f
Jun 26 00:30:49 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:49 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.774s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:49 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6f38578d-bcbe-4683-8adb-03c82239a805 tempest-GroupsV314Test-1033260792 None] Delete group completed successfully.
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Acquiring lock "cinder-quobyte-0383ee98-6abd-4575-ab10-c3f123d1d686" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-0383ee98-6abd-4575-ab10-c3f123d1d686" acquired by "delete_volume" :: waited 0.054s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:30:50 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" returned: 0 in 0.929s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39099c-245e-4e26-96d0-b59c22128403]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65dea3b8-b7f8-4f48-9c62-a344e74d5738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd71961-9fbb-4b53-842e-e5f166bd2f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:30:50 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Volume volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f (cf6a4ea7-2272-4490-ab60-e1276ef8d31f): created successfully
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd71961-9fbb-4b53-842e-e5f166bd2f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:30:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (03c98f89-cc7e-4fad-a827-f0e18337d98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:30:50 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-277a364c-6e6b-41b8-90f0-ff0e8f61f06b tempest-GroupSnapshotsTest-1709639757 None] Created volume successfully.
Jun 26 00:30:50 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:50 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:50 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c0f0d0c7-4b9c-496d-8b3d-668b2ffdc3bf tempest-GroupSnapshotsTest-1709639757 None] Update group completed successfully.
Jun 26 00:30:51 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 0.895s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:51 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686
Jun 26 00:30:51 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:51 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0383ee98-6abd-4575-ab10-c3f123d1d686" returned: 0 in 0.783s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Lock "cinder-quobyte-0383ee98-6abd-4575-ab10-c3f123d1d686" released by "delete_volume" :: held 1.824s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Created reservations ['3ddc3108-98a6-420c-92df-c673c8b10a58'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:52 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a9f889fe-ee4d-4005-9869-2006b8b3c1c1 tempest-GroupSnapshotsTest-1709639757 None] Update group completed successfully.
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Created reservations ['22129f47-023c-42db-bac2-57bdb21751c6', '48195011-d79c-467b-8d2e-258cb8c1d0f5', 'c3e86dd5-de0e-4b2f-b7bf-d2104555eb14', '51a8303a-ab43-42ca-b7f8-ad373c77e46e'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:30:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:52 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:30:52 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:53 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.875s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:53 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:30:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e85ee1e4-af6f-47b0-bb23-464414f023ae tempest-GroupsV314Test-1033260792 None] Delete group completed successfully.
Jun 26 00:30:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a7667448-f822-4a9b-bf23-407b384f44a3 tempest-GroupSnapshotsTest-1709639757 None] Update group completed successfully.
Jun 26 00:30:54 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ee5c51e2-0a1b-4789-928a-8c154715ecc1 tempest-GroupSnapshotsTest-1709639757 None] Update group completed successfully.
Jun 26 00:30:56 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] GroupSnapshot 109be35c-2f7e-4736-8bdf-c0fccb420f4a: creating.
Jun 26 00:30:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Group snapshot 109be35c-2f7e-4736-8bdf-c0fccb420f4a: creating. {{(pid=94563) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 00:30:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:30:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:30:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Creating offline snapshot 12b1af0b-3399-44de-9352-8d373b3ba6ac of volume e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:30:56 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73ca364-2c87-4451-b0ab-fa32f9a46ed1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:30:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:56 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791
Jun 26 00:30:56 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:57 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791" returned: 0 in 0.969s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:57 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac 1G
Jun 26 00:30:57 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:58 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac 1G" returned: 0 in 1.286s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:58 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac
Jun 26 00:30:58 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:59 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Jun 26 00:30:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac" returned: 0 in 0.936s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:30:59 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:30:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:30:59 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac
Jun 26 00:30:59 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:30:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-246f239c-ccdf-49bc-ae53-dca24a36c866 tempest-GroupsV320Test-2088491535 None] Group tempest-GroupsV320Test-Group-637886251: creating
Jun 26 00:30:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-246f239c-ccdf-49bc-ae53-dca24a36c866 tempest-GroupsV320Test-2088491535 None] Group tempest-GroupsV320Test-Group-637886251: created successfully
Jun 26 00:30:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-246f239c-ccdf-49bc-ae53-dca24a36c866 tempest-GroupsV320Test-2088491535 None] Create group completed successfully.
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac" returned: 0 in 0.924s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:00 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:00 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info
Jun 26 00:31:00 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:31:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:01 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:31:01 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:01 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info" returned: 0 in 0.867s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:01 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:01 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info
Jun 26 00:31:01 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Created reservations ['f57ddcf9-ac35-48a6-87d3-93fc15090c2c'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:01 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:31:01 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:02 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.087s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:31:02 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.info" returned: 0 in 0.875s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.970s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Creating offline snapshot fc810fcc-7457-4291-af6f-c3fc008eded9 of volume cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[611dfd4b-fc50-491c-959a-573b097b82b3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:02 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f
Jun 26 00:31:02 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:02 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.802s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:31:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2fcda732-f517-44c6-bc22-e94e4817e617 tempest-GroupsV320Test-2088491535 None] Delete group completed successfully.
Jun 26 00:31:03 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" returned: 0 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:03 devstack sudo[107658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 1G
Jun 26 00:31:03 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:04 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 1G" returned: 0 in 0.993s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:04 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9
Jun 26 00:31:04 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:05 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9" returned: 0 in 0.863s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:05 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:31:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:05 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9
Jun 26 00:31:05 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:05 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:06 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info
Jun 26 00:31:06 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:07 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info" returned: 0 in 1.366s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:07 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:31:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:07 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info
Jun 26 00:31:07 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:08 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.info" returned: 0 in 1.005s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.121s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9406a03f-0012-4724-beeb-c25fb081d7dd tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 109be35c-2f7e-4736-8bdf-c0fccb420f4a: created successfully
Jun 26 00:31:09 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 109be35c-2f7e-4736-8bdf-c0fccb420f4a: deleting
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 109be35c-2f7e-4736-8bdf-c0fccb420f4a: deleting {{(pid=94563) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-e1d6c967-949b-448f-9d1a-196bcd8c5791" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e1d6c967-949b-448f-9d1a-196bcd8c5791" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-12b1af0b-3399-44de-9352-8d373b3ba6ac" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-12b1af0b-3399-44de-9352-8d373b3ba6ac" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Deleting offline snapshot 12b1af0b-3399-44de-9352-8d373b3ba6ac of volume e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] snapshot_file for this snap is: volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acfe3e4-e309-408c-bf7b-881c026cf5de]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:09 devstack sudo[107763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac
Jun 26 00:31:09 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99ccb7bf-e446-48cb-8796-d104c96b0d8c tempest-VolumesActionsTest-1755753613 None] Acquiring lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103" by "attach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99ccb7bf-e446-48cb-8796-d104c96b0d8c tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103" acquired by "attach_volume" :: waited 0.051s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-99ccb7bf-e446-48cb-8796-d104c96b0d8c tempest-VolumesActionsTest-1755753613 None] Attaching volume 8444240a-fd7f-4e23-9fd2-d6bc72a19103 to instance 0222d62d-b0d4-468f-80bc-1791bc0c1e6b at mountpoint /dev/vdb on host None.
Jun 26 00:31:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-99ccb7bf-e446-48cb-8796-d104c96b0d8c tempest-VolumesActionsTest-1755753613 None] Attach volume completed successfully.
Jun 26 00:31:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99ccb7bf-e446-48cb-8796-d104c96b0d8c tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103" released by "attach_volume" :: held 0.164s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:11 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac" returned: 0 in 1.483s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d6c967-949b-448f-9d1a-196bcd8c5791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cfa5f0-c794-4456-a8f7-9b237fc12d3d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:11 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791
Jun 26 00:31:11 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2998a1bb-5347-44c5-831e-195a0550ab4f tempest-VolumesActionsTest-1755753613 None] Acquiring lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-detach_volume" by "detach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2998a1bb-5347-44c5-831e-195a0550ab4f tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2998a1bb-5347-44c5-831e-195a0550ab4f tempest-VolumesActionsTest-1755753613 None] Detaching volume 8444240a-fd7f-4e23-9fd2-d6bc72a19103 from instance 0222d62d-b0d4-468f-80bc-1791bc0c1e6b.
Jun 26 00:31:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2998a1bb-5347-44c5-831e-195a0550ab4f tempest-VolumesActionsTest-1755753613 None] Detach volume completed successfully.
Jun 26 00:31:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2998a1bb-5347-44c5-831e-195a0550ab4f tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:12 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791" returned: 0 in 1.586s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:12 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac
Jun 26 00:31:12 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:14 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac" returned: 0 in 1.331s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:14 devstack sudo[107826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac
Jun 26 00:31:14 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:14 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791.12b1af0b-3399-44de-9352-8d373b3ba6ac" returned: 0 in 0.807s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-12b1af0b-3399-44de-9352-8d373b3ba6ac" released by "_delete_snapshot" :: held 5.385s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e1d6c967-949b-448f-9d1a-196bcd8c5791" released by "delete_snapshot" :: held 5.431s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-fc810fcc-7457-4291-af6f-c3fc008eded9" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-fc810fcc-7457-4291-af6f-c3fc008eded9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Deleting offline snapshot fc810fcc-7457-4291-af6f-c3fc008eded9 of volume cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:31:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] snapshot_file for this snap is: volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:31:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd591f0-e4d8-4bc5-8348-a0e91ba8f6b6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:15 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9
Jun 26 00:31:15 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:16 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9" returned: 0 in 1.299s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:31:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c59e11-4959-420d-8156-f316c6d374c3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:16 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f
Jun 26 00:31:16 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:17 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" returned: 0 in 1.143s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:17 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9
Jun 26 00:31:17 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:18 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9" returned: 0 in 0.918s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:18 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9
Jun 26 00:31:18 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:19 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f.fc810fcc-7457-4291-af6f-c3fc008eded9" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-fc810fcc-7457-4291-af6f-c3fc008eded9" released by "_delete_snapshot" :: held 4.273s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" released by "delete_snapshot" :: held 4.302s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:19 devstack cinder-volume[94563]: WARNING cinder.quota [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-976196358 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-976196358, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:31:19 devstack cinder-volume[94563]: WARNING cinder.quota [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-976196358 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-976196358, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:31:19 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['f70f9b81-585a-46fc-9d83-83ac6b08ea05', 'e74896dc-e641-4e3c-887c-cf70b0551a84', 'e3611f78-62a8-4622-bf64-824147d02f45', 'a05074c7-9ed8-44ef-a90f-a0168b1a5679'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:31:19 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['52b6e325-172a-478c-995b-de2e4795560f', 'ee7d2c3b-2287-40cd-b09c-bbf195a7805b', '5cbd91b1-13ef-40e7-b719-f37dd5d5de1f', '1a148d8b-9187-44e2-8c11-b2b47e3d4132'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:31:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-13e135a0-3f16-42e0-aa13-1fb78420b5f2 tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 109be35c-2f7e-4736-8bdf-c0fccb420f4a: deleted successfully
Jun 26 00:31:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48fedbd-fb94-4c5d-aa14-c022260d6160]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:21 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f
Jun 26 00:31:21 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:22 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" returned: 0 in 0.953s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:22 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f
Jun 26 00:31:22 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed2c4ee-95a1-4b7f-a039-9cae288c09f2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:23 devstack sudo[107860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:31:23 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:23 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" returned: 0 in 1.029s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-cf6a4ea7-2272-4490-ab60-e1276ef8d31f" released by "delete_volume" :: held 2.106s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-e1d6c967-949b-448f-9d1a-196bcd8c5791" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e1d6c967-949b-448f-9d1a-196bcd8c5791" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85dd7de-fe32-4956-99b7-36d8105fdec6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:23 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791
Jun 26 00:31:23 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:24 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 1.182s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[044493fb-8b5c-4f59-b3c5-aefa9b1a73b6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:24 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:31:24 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:25 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791" returned: 0 in 1.628s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:25 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791
Jun 26 00:31:25 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:25 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 1.318s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.9b27d392-acf7-4bb7-a4a0-3bb586bb9dacly18yyu8.img {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:25 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.9b27d392-acf7-4bb7-a4a0-3bb586bb9dacly18yyu8.img
Jun 26 00:31:25 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:26 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1d6c967-949b-448f-9d1a-196bcd8c5791" returned: 0 in 1.051s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-e1d6c967-949b-448f-9d1a-196bcd8c5791" released by "delete_volume" :: held 2.799s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['5e403e98-c9f7-4665-aeb6-5dbc01c41403'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:31:26 devstack cinder-volume[94563]: WARNING cinder.quota [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-976196358 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-976196358, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['cce96337-91d8-4d4f-ae00-ee2949ac91b6', '2e48ab7a-f6b5-427c-a3ea-f01026531c9a', '0736845a-0e7c-46d5-8ea0-28fffcd8ca86', '021a56e5-6805-4257-88cf-522a84c2790e'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['77131bed-1e18-4d8f-a7e5-61c62f16689b', 'a6899cbb-c0ff-4e1d-a247-f40ca58fbb9a', '024795a8-f8d4-49d5-a647-13924103a046', 'fee336cd-bce0-42d9-96ca-a4fd2a2aa86d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:27 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:31:27 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f4c724b6-c447-4659-b011-9b870f75225b tempest-GroupSnapshotsTest-1709639757 None] Group tempest-GroupSnapshotsTest-Group-185156044: creating
Jun 26 00:31:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f4c724b6-c447-4659-b011-9b870f75225b tempest-GroupSnapshotsTest-1709639757 None] Group tempest-GroupSnapshotsTest-Group-185156044: created successfully
Jun 26 00:31:29 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 2.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:29 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:31:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f4c724b6-c447-4659-b011-9b870f75225b tempest-GroupSnapshotsTest-1709639757 None] Create group completed successfully.
Jun 26 00:31:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9b0c2b42-e6df-4dff-8043-e7c7b9ef814a tempest-GroupSnapshotsTest-1709639757 None] Delete group completed successfully.
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (6442a33a-d061-4ad5-b687-5e00da64f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa0e745-8a1c-48bd-ae5c-fd4a6ac88d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa0e745-8a1c-48bd-ae5c-fd4a6ac88d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1431992991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cfb452e2-9bff-4197-a6b3-d1e3973b9f4c,host='devstack@QuobyteHD#QuobyteHD',id=155d787e-c7a9-4c86-b93f-b6a07a95816b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:31:32Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cce05727-af99-444d-b22c-8302965ba6e9),volume_type_id=cce05727-af99-444d-b22c-8302965ba6e9)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bdd390-3981-4eb0-b97d-cf98d987fe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bdd390-3981-4eb0-b97d-cf98d987fe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5ac89f-0d5d-423c-a547-9a28ddd4c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5ac89f-0d5d-423c-a547-9a28ddd4c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155d787e-c7a9-4c86-b93f-b6a07a95816b', 'volume_name': 'volume-155d787e-c7a9-4c86-b93f-b6a07a95816b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2470ebcd-6e3a-4506-9b00-7c1e2484d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2470ebcd-6e3a-4506-9b00-7c1e2484d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6827399-3246-4de5-b7f7-2d502d3ee8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:32 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Volume 155d787e-c7a9-4c86-b93f-b6a07a95816b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155d787e-c7a9-4c86-b93f-b6a07a95816b', 'volume_size': 1}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:32 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.9b27d392-acf7-4bb7-a4a0-3bb586bb9dacly18yyu8.img" returned: 0 in 6.994s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9c1bc-cde6-4d20-aac5-640708dda569]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:32 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:31:32 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:33 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 1.291s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:33 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.9b27d392-acf7-4bb7-a4a0-3bb586bb9dacly18yyu8.img {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:31:33 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Converted 1024.00 MB image at 146.35 MB/s
Jun 26 00:31:33 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] 9b27d392-acf7-4bb7-a4a0-3bb586bb9dac was raw, no need to convert to raw {{(pid=94563) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 26 00:31:36 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=100,cinder:INSERT=21,cinder:UPDATE=84,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Flow 'volume_create_manager' (beb97adf-da8e-42e9-a5b3-4c97b5605226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de14666-e8c8-42d5-993f-3d4d48045b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de14666-e8c8-42d5-993f-3d4d48045b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-865000292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1174c2b3-e379-4ccb-b724-187bd72ee0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e980a33dd79f4db9b9fcce315d68bdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:31:37Z,use_quota=True,user_id='e60749ff5a1b4accb5cd4893bb28193c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751274d9-0b56-4541-beab-43efae77f8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751274d9-0b56-4541-beab-43efae77f8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656e0e14-37fc-476e-a32d-bcaf591814cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656e0e14-37fc-476e-a32d-bcaf591814cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1174c2b3-e379-4ccb-b724-187bd72ee0a9', 'volume_name': 'volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac46b6c-5e2e-4aa0-a1b6-155b14c2410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac46b6c-5e2e-4aa0-a1b6-155b14c2410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef007d6-f60b-49ce-820c-5f6e7509b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:37 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Volume 1174c2b3-e379-4ccb-b724-187bd72ee0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9', 'volume_size': 1}
Jun 26 00:31:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Flow 'volume_create_manager' (3612e24b-8982-40b1-98a2-88bd028ab9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4316572-91c7-4d89-b709-c8bdee7da89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=74,cinder:SELECT=70,cinder:INSERT=15 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4316572-91c7-4d89-b709-c8bdee7da89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1307985290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6828ccb-26ea-4492-8be7-8242a32eef0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaa088837b64168a49adc265efd9dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:31:51Z,use_quota=True,user_id='2dab2af1cb9b435486124498c457d965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f416275-dc44-4abb-95df-2362e3b3e4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f416275-dc44-4abb-95df-2362e3b3e4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ea880a-d9c9-4b2a-a2d1-99e2dad2cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ea880a-d9c9-4b2a-a2d1-99e2dad2cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6828ccb-26ea-4492-8be7-8242a32eef0d', 'volume_name': 'volume-f6828ccb-26ea-4492-8be7-8242a32eef0d', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e245a03e750>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513b4b99-1267-4c06-b09a-a9cc016efa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513b4b99-1267-4c06-b09a-a9cc016efa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386dadf2-79d2-4343-ad16-746602af0245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:31:50 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Volume f6828ccb-26ea-4492-8be7-8242a32eef0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6828ccb-26ea-4492-8be7-8242a32eef0d', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e245a03e750>}
Jun 26 00:31:50 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Trying to clone f6828ccb-26ea-4492-8be7-8242a32eef0d from image d33d2e37-1f9c-49c4-8c97-bf2e836714db at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:31:51 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:31:51 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 00:31:51 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f4e8d-1b4c-41b2-87fa-d2d19a985f48]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:51 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD
Jun 26 00:31:51 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:52 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD" returned: 0 in 1.281s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:52 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db is fetched for user 2dab2af1cb9b435486124498c457d965. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:31:52 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06161d-9819-42c2-983c-40277adba5d5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:31:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:53 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD
Jun 26 00:31:53 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:53 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Jun 26 00:31:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD" returned: 0 in 0.942s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:31:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.489s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Uploaded volume to glance image-id: 9b27d392-acf7-4bb7-a4a0-3bb586bb9dac. {{(pid=94563) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.090s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cfb452e2-9bff-4197-a6b3-d1e3973b9f4c,created_at=2026-06-25T22:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1431992991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cfb452e2-9bff-4197-a6b3-d1e3973b9f4c,host='devstack@QuobyteHD#QuobyteHD',id=155d787e-c7a9-4c86-b93f-b6a07a95816b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd1738a86534e09bebc604079900709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:31:32Z,use_quota=True,user_id='1bee0baaf95c45a6841c2ceda4fe7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cce05727-af99-444d-b22c-8302965ba6e9),volume_type_id=cce05727-af99-444d-b22c-8302965ba6e9)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Creating volume 155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:31:59 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:31:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:31:59 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b 1073741824
Jun 26 00:31:59 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:31:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b74c6121-60d7-42c4-a084-d704170e46df tempest-VolumesActionsTest-1755753613 None] Copy volume to image completed successfully.
Jun 26 00:32:00 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b 1073741824" returned: 0 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:00 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b
Jun 26 00:32:00 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:32:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:01 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:32:01 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:01 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b" returned: 0 in 0.772s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.270s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-865000292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1174c2b3-e379-4ccb-b724-187bd72ee0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e980a33dd79f4db9b9fcce315d68bdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:31:37Z,use_quota=True,user_id='e60749ff5a1b4accb5cd4893bb28193c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Creating volume 1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:32:01 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6827399-3246-4de5-b7f7-2d502d3ee8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155d787e-c7a9-4c86-b93f-b6a07a95816b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:01 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 1073741824
Jun 26 00:32:01 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187a638f-40f8-429e-95f9-6cef2a737bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Volume volume-155d787e-c7a9-4c86-b93f-b6a07a95816b (155d787e-c7a9-4c86-b93f-b6a07a95816b): created successfully
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187a638f-40f8-429e-95f9-6cef2a737bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Flow 'volume_create_manager' (6442a33a-d061-4ad5-b687-5e00da64f83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6e6ad8f1-ea35-42b3-a04a-22efe78f4153 tempest-GroupSnapshotsTest-1709639757 None] Created volume successfully.
Jun 26 00:32:01 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.819s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:32:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:32:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] GroupSnapshot 20af01e8-6399-4ec7-8b16-1a2ec0e12057: creating.
Jun 26 00:32:02 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 1073741824" returned: 0 in 1.055s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Group snapshot 20af01e8-6399-4ec7-8b16-1a2ec0e12057: creating. {{(pid=94563) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 00:32:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:02 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:32:02 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:03 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.685s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.342s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1307985290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6828ccb-26ea-4492-8be7-8242a32eef0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaa088837b64168a49adc265efd9dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:31:51Z,use_quota=True,user_id='2dab2af1cb9b435486124498c457d965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Creating volume f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:32:03 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef007d6-f60b-49ce-820c-5f6e7509b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418b5d3d-0042-43a5-80e2-b2dcc9deeb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:03 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d 1073741824
Jun 26 00:32:03 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Volume volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 (1174c2b3-e379-4ccb-b724-187bd72ee0a9): created successfully
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418b5d3d-0042-43a5-80e2-b2dcc9deeb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Flow 'volume_create_manager' (beb97adf-da8e-42e9-a5b3-4c97b5605226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cc86fe3a-3e73-4b18-8216-34877eee121c tempest-TestStampPattern-934689577 None] Created volume successfully.
Jun 26 00:32:04 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d 1073741824" returned: 0 in 0.956s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:04 devstack sudo[108098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:04 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:04 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 0 in 0.696s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.813s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e901ffbf-3cce-4a4b-be04-72428f30b74c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Attempting download of d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume f6828ccb-26ea-4492-8be7-8242a32eef0d. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ab32b-f6a9-4849-8ab1-532eb9c2399d]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:05 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:32:05 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:05 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k
Jun 26 00:32:05 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:05 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992572e-e1ce-477c-9030-56a4a5e55408]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:05 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:32:05 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:05 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k" returned: 0 in 0.866s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:06 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k
Jun 26 00:32:06 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:06 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 0.889s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:06 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img
Jun 26 00:32:06 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:06 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k" returned: 1 in 0.862s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33d2e37-1f9c-49c4-8c97-bf2e836714db_fdmdat6k' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:32:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed2da5-9082-4216-bda8-ed8f5de0426a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:06 devstack sudo[108146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD
Jun 26 00:32:06 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:07 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD" returned: 0 in 1.031s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:07 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] d33d2e37-1f9c-49c4-8c97-bf2e836714db was qcow2, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:32:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:07 devstack sudo[108163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:07 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:11 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img" returned: 0 in 5.119s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee7dbc-3c13-483d-a9d5-023828e1cd05]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:11 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 0 in 4.017s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:11 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33d2e37-1f9c-49c4-8c97-bf2e836714db_i5j4ynaodevstack@QuobyteHD, size 112.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:32:11 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Converted 112.00 MB image at 27.86 MB/s
Jun 26 00:32:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:11 devstack sudo[108181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d 1G
Jun 26 00:32:11 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:11 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:32:11 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:12 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d 1G" returned: 0 in 0.672s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac67cc6-9ca5-417e-ab2a-c13923412326]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:12 devstack sudo[108189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:12 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:12 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 0.922s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:32:12 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Converted 1024.00 MB image at 199.98 MB/s
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] 619dcb68-77b8-49b5-8c75-59aa7a96062d was raw, converting to qcow2 {{(pid=94563) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[877a4cc9-f6e0-4ff6-92d2-4b7752e2bf88]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:12 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img
Jun 26 00:32:12 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:13 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 0 in 0.775s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:13 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:13 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:13 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img" returned: 0 in 0.793s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:13 devstack sudo[108200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img
Jun 26 00:32:13 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:14 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 1 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Downloaded image d33d2e37-1f9c-49c4-8c97-bf2e836714db ((None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}])) to volume f6828ccb-26ea-4492-8be7-8242a32eef0d successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Temporary image d33d2e37-1f9c-49c4-8c97-bf2e836714db for user 2dab2af1cb9b435486124498c457d965 is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Marking volume f6828ccb-26ea-4492-8be7-8242a32eef0d as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Copying metadata from image d33d2e37-1f9c-49c4-8c97-bf2e836714db to f6828ccb-26ea-4492-8be7-8242a32eef0d. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Creating volume glance metadata for volume f6828ccb-26ea-4492-8be7-8242a32eef0d backed by image d33d2e37-1f9c-49c4-8c97-bf2e836714db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386dadf2-79d2-4343-ad16-746602af0245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6828ccb-26ea-4492-8be7-8242a32eef0d', 'volume_size': 1, 'image_id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '718e35be5a144cdbbab27c63627b9828', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33d2e37-1f9c-49c4-8c97-bf2e836714db', 'created_at': datetime.datetime(2026, 6, 25, 22, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33d2e37-1f9c-49c4-8c97-bf2e836714db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e245a03e750>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd8714c-91cd-4abc-bf02-ccf9a10c0ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Volume volume-f6828ccb-26ea-4492-8be7-8242a32eef0d (f6828ccb-26ea-4492-8be7-8242a32eef0d): created successfully
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd8714c-91cd-4abc-bf02-ccf9a10c0ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Flow 'volume_create_manager' (3612e24b-8982-40b1-98a2-88bd028ab9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4c3c79f9-8f44-4cd3-bd6b-0a90c288a8fa tempest-VolumesImageMetadata-1622660316 None] Created volume successfully.
Jun 26 00:32:14 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img" returned: 1 in 0.796s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:32:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img /opt/stack/data/cinder/conversion/vol_upload_4r96hlll {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:14 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img /opt/stack/data/cinder/conversion/vol_upload_4r96hlll
Jun 26 00:32:14 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:15 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img /opt/stack/data/cinder/conversion/vol_upload_4r96hlll" returned: 0 in 0.667s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Image conversion details: src /opt/stack/data/cinder/conversion/8444240a-fd7f-4e23-9fd2-d6bc72a19103.temp_image.619dcb68-77b8-49b5-8c75-59aa7a96062dz8j_eclc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4r96hlll {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:32:15 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb84ee-0ccc-4a3b-abef-2b9c06e958d5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4r96hlll {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:15 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4r96hlll
Jun 26 00:32:15 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Acquiring lock "cinder-f6828ccb-26ea-4492-8be7-8242a32eef0d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Lock "cinder-f6828ccb-26ea-4492-8be7-8242a32eef0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Acquiring lock "cinder-quobyte-f6828ccb-26ea-4492-8be7-8242a32eef0d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Lock "cinder-quobyte-f6828ccb-26ea-4492-8be7-8242a32eef0d" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2237dae-7558-4f86-96af-ec94bb1cbd37]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:15 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:15 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:15 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4r96hlll" returned: 0 in 0.721s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:16 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 0 in 0.771s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:16 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:16 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:16 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 1 in 0.776s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:32:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:16 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d
Jun 26 00:32:16 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.150s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Uploaded volume to glance image-id: 619dcb68-77b8-49b5-8c75-59aa7a96062d. {{(pid=94563) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.590s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Creating offline snapshot 81edb23a-0f0d-40ff-8012-a3eea753030b of volume 155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:32:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-de2b1c75-bfd0-4934-83d6-fb681711c491 tempest-VolumesActionsTest-1755753613 None] Copy volume to image completed successfully.
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb7b523-1b2a-4cc9-a140-3128c25ed41c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:17 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b
Jun 26 00:32:17 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:17 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f6828ccb-26ea-4492-8be7-8242a32eef0d" returned: 0 in 0.661s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Lock "cinder-quobyte-f6828ccb-26ea-4492-8be7-8242a32eef0d" released by "delete_volume" :: held 2.267s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Created reservations ['8ac41052-185c-42a4-8263-a37fae0b2186', '3bba0937-5174-4906-be15-42349ee14d89', '9b9e1923-1b97-4b62-ae9f-e0b9e52aade1', '98d72e06-a1f0-42b8-87e7-0879110fa330'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:17 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:32:17 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:17 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b" returned: 0 in 0.774s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:17 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b 1G
Jun 26 00:32:17 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:18 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.713s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:32:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Deleted volume successfully.
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e7c2f3e1-398b-4216-8bb5-dc39dec5aaa7 tempest-VolumesImageMetadata-1622660316 None] Lock "cinder-f6828ccb-26ea-4492-8be7-8242a32eef0d-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Acquiring lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Acquiring lock "cinder-quobyte-8444240a-fd7f-4e23-9fd2-d6bc72a19103" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Lock "cinder-quobyte-8444240a-fd7f-4e23-9fd2-d6bc72a19103" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feb3c37-5b93-4cda-971a-18e406277739]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:18 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:32:18 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:18 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b 1G" returned: 0 in 0.999s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-155d787e-c7a9-4c86-b93f-b6a07a95816b -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:18 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-155d787e-c7a9-4c86-b93f-b6a07a95816b -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b
Jun 26 00:32:18 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:19 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 0.964s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:19 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-155d787e-c7a9-4c86-b93f-b6a07a95816b -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b" returned: 0 in 0.865s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:19 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:32:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:19 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103
Jun 26 00:32:19 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:19 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b
Jun 26 00:32:19 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:20 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8444240a-fd7f-4e23-9fd2-d6bc72a19103" returned: 0 in 0.746s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Lock "cinder-quobyte-8444240a-fd7f-4e23-9fd2-d6bc72a19103" released by "delete_volume" :: held 1.759s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:20 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b" returned: 0 in 0.759s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Created reservations ['efadc61d-fc81-48a3-b251-b35a635cb4b0', '7ca128ee-5dc4-49e1-9758-e3be851bb9e6', 'ba608c40-539a-4df6-9a16-b5dce824d0a3', 'adb085ed-6f96-4abd-a124-eb2b363899ae'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:20 devstack sudo[108272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info
Jun 26 00:32:20 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:20 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:32:20 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:21 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info" returned: 0 in 0.798s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:21 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 00:32:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:21 devstack sudo[108277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info
Jun 26 00:32:21 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:21 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.868s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:21 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:32:21 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Deleted volume successfully.
Jun 26 00:32:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fbe7ff66-212c-46dc-bb0a-f4d99964988d tempest-VolumesActionsTest-1755753613 None] Lock "cinder-8444240a-fd7f-4e23-9fd2-d6bc72a19103-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Flow 'volume_create_manager' (eeb8ec89-a6f5-47f2-b5fb-ffc57428edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1edb96-643d-4085-9513-de51fadbbb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1edb96-643d-4085-9513-de51fadbbb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-446701784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7c49c6-2850-4b80-aa50-5512000bc1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9226d53e34bb45c8bbf7c2f96f595e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:22Z,use_quota=True,user_id='0037dd8230ca44e5ae0096f194f26870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f8177b-4153-4100-b286-0af3fa41a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f8177b-4153-4100-b286-0af3fa41a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbad66e-0322-494d-b334-932fb9ee3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbad66e-0322-494d-b334-932fb9ee3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7c49c6-2850-4b80-aa50-5512000bc1ba', 'volume_name': 'volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd5bfe6-2e72-4fe2-abdc-4ee08776c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd5bfe6-2e72-4fe2-abdc-4ee08776c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744787b7-8553-442f-a7e4-d26ae4fd6575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:22 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Volume 2a7c49c6-2850-4b80-aa50-5512000bc1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba', 'volume_size': 1}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:22 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.info" returned: 0 in 0.844s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.151s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-446701784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7c49c6-2850-4b80-aa50-5512000bc1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9226d53e34bb45c8bbf7c2f96f595e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:22Z,use_quota=True,user_id='0037dd8230ca44e5ae0096f194f26870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Creating volume 2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:32:22 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:22 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba 1073741824
Jun 26 00:32:22 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f0086c98-1da6-4f56-8868-4fcffab6e0b1 tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 20af01e8-6399-4ec7-8b16-1a2ec0e12057: created successfully
Jun 26 00:32:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 20af01e8-6399-4ec7-8b16-1a2ec0e12057: deleting
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 20af01e8-6399-4ec7-8b16-1a2ec0e12057: deleting {{(pid=94563) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-155d787e-c7a9-4c86-b93f-b6a07a95816b" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-155d787e-c7a9-4c86-b93f-b6a07a95816b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-81edb23a-0f0d-40ff-8012-a3eea753030b" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-81edb23a-0f0d-40ff-8012-a3eea753030b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Deleting offline snapshot 81edb23a-0f0d-40ff-8012-a3eea753030b of volume 155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] snapshot_file for this snap is: volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4fa60c-ff42-4f03-ac64-b36b58c6573e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:22 devstack sudo[108293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b
Jun 26 00:32:22 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:23 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba 1073741824" returned: 0 in 1.064s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:23 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba
Jun 26 00:32:23 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:23 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b" returned: 0 in 0.880s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-155d787e-c7a9-4c86-b93f-b6a07a95816b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:32:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce7994-d70e-4982-85ed-9fd7015c96c7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:23 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b
Jun 26 00:32:23 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba" returned: 0 in 0.849s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:24 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744787b7-8553-442f-a7e4-d26ae4fd6575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7c168a-3097-49e7-b8d1-f40ac8a45dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ff5c1-b018-47a3-bbad-b1ceac0f46a5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Volume volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba (2a7c49c6-2850-4b80-aa50-5512000bc1ba): created successfully
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7c168a-3097-49e7-b8d1-f40ac8a45dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Flow 'volume_create_manager' (eeb8ec89-a6f5-47f2-b5fb-ffc57428edb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-dc21d94c-4cf6-4918-ab2c-a0c4b76b0846 tempest-SnapshotMetadataTestJSON-165578141 None] Created volume successfully.
Jun 26 00:32:24 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:32:24 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:24 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b" returned: 0 in 0.962s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:24 devstack sudo[108347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b
Jun 26 00:32:24 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:25 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.946s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.997s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6a3b854-5171-4324-81b5-b14c12879bb6', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:32:25 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-ab06457a-c722-4894-ac84-5bd31e369a80 req-a555429f-f791-488f-a80b-bb4631bcf568 tempest-TestStampPattern-934689577 None] attachment_update completed successfully.
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Creating offline snapshot 56138ccb-a874-4af4-b665-ae9d181a07d8 of volume 2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c227eda-e821-4781-807a-f0f9f0a27011]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:25 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba
Jun 26 00:32:25 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:25 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b" returned: 0 in 1.132s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:25 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b
Jun 26 00:32:25 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:26 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba" returned: 0 in 1.000s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:26 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:26 devstack sudo[108749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 1G
Jun 26 00:32:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b.81edb23a-0f0d-40ff-8012-a3eea753030b" returned: 0 in 0.807s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:26 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-81edb23a-0f0d-40ff-8012-a3eea753030b" released by "_delete_snapshot" :: held 3.981s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-155d787e-c7a9-4c86-b93f-b6a07a95816b" released by "delete_snapshot" :: held 4.015s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:26 devstack cinder-volume[94563]: WARNING cinder.quota [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1994937325 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1994937325, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:32:26 devstack cinder-volume[94563]: WARNING cinder.quota [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1994937325 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1994937325, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:32:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['f27dbd3b-9ee3-4f12-98fc-fcc43ffb44bb', '2ab0dc2d-7af7-4635-be15-04d0e22eafd7', '9a9587d4-7362-4a04-90cb-8fec8f5ab0f7', '7d6d8170-e203-408c-ac44-f1eba9736152'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-31356589-44c3-48b4-87be-b8f309d5161e tempest-GroupSnapshotsTest-1709639757 None] group_snapshot 20af01e8-6399-4ec7-8b16-1a2ec0e12057: deleted successfully
Jun 26 00:32:27 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 1G" returned: 0 in 0.943s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:27 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8
Jun 26 00:32:27 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "cinder-quobyte-155d787e-c7a9-4c86-b93f-b6a07a95816b" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-155d787e-c7a9-4c86-b93f-b6a07a95816b" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:28 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac56a005-12e1-4817-9f97-409283b7ecb6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:28 devstack sudo[108759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b
Jun 26 00:32:28 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:28 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8" returned: 0 in 0.812s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:28 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 is being set with open permissions: ugo+rw
Jun 26 00:32:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:28 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8
Jun 26 00:32:28 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:28 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b" returned: 0 in 0.925s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:29 devstack sudo[108769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b
Jun 26 00:32:29 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:29 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8" returned: 0 in 0.779s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:29 devstack sudo[108772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info
Jun 26 00:32:29 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:29 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-155d787e-c7a9-4c86-b93f-b6a07a95816b" returned: 0 in 0.732s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Lock "cinder-quobyte-155d787e-c7a9-4c86-b93f-b6a07a95816b" released by "delete_volume" :: held 1.783s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['4572b93d-ff12-45d0-b7d8-322d332b5dcb'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:29 devstack cinder-volume[94563]: WARNING cinder.quota [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1994937325 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1994937325, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Created reservations ['0ce69e52-9b56-4487-9ec8-9995dbed76bf', 'ad97473c-ecfb-41f0-a753-f81398134f40', '18eccc5b-c364-4640-917b-65fd82e5a2ee', '37c44145-65d1-49f7-bfa2-9c2acc0e26d2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:29 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info" returned: 0 in 0.770s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:29 devstack sudo[108776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:32:30 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info is being set with open permissions: ugo+rw
Jun 26 00:32:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:30 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:30 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info
Jun 26 00:32:30 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:30 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.909s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:30 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:32:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c26747b7-d3ff-4576-ab18-6a73f8dea3bd tempest-GroupSnapshotsTest-1709639757 None] Delete group completed successfully.
Jun 26 00:32:31 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.info" returned: 0 in 1.201s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.613s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:31 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0393858e-6299-464a-b161-f9ba6ae48fc9 tempest-SnapshotMetadataTestJSON-165578141 None] Create snapshot completed successfully
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "cinder-56138ccb-a874-4af4-b665-ae9d181a07d8-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-56138ccb-a874-4af4-b665-ae9d181a07d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "cinder-quobyte-2a7c49c6-2850-4b80-aa50-5512000bc1ba" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-quobyte-2a7c49c6-2850-4b80-aa50-5512000bc1ba" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "cinder-quobyte-56138ccb-a874-4af4-b665-ae9d181a07d8" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-quobyte-56138ccb-a874-4af4-b665-ae9d181a07d8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Deleting offline snapshot 56138ccb-a874-4af4-b665-ae9d181a07d8 of volume 2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] snapshot_file for this snap is: volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f795151-78e1-4115-bd1f-5e4cb3d22f51]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:33 devstack sudo[108792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8
Jun 26 00:32:33 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:34 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8" returned: 0 in 1.132s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:32:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c7885-d85a-4d12-8b61-8063b818c8f7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:34 devstack sudo[108810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba
Jun 26 00:32:34 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:35 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba" returned: 0 in 0.976s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:35 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8
Jun 26 00:32:35 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:36 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8" returned: 0 in 1.114s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:36 devstack sudo[108851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8
Jun 26 00:32:36 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-c77238ca-4ef6-420d-815b-5cfb6368222f req-332bff4a-47ff-4d40-b597-64dfdd148efb tempest-TestStampPattern-934689577 None] Terminate volume connection completed successfully.
Jun 26 00:32:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-c77238ca-4ef6-420d-815b-5cfb6368222f req-332bff4a-47ff-4d40-b597-64dfdd148efb tempest-TestStampPattern-934689577 None] Deleting attachment c6a3b854-5171-4324-81b5-b14c12879bb6. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:32:37 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba.56138ccb-a874-4af4-b665-ae9d181a07d8" returned: 0 in 1.071s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-quobyte-56138ccb-a874-4af4-b665-ae9d181a07d8" released by "_delete_snapshot" :: held 4.453s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-quobyte-2a7c49c6-2850-4b80-aa50-5512000bc1ba" released by "delete_snapshot" :: held 4.487s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:37 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Created reservations ['793f9835-4296-4408-9f91-f7801970cc15', 'a4c3aeb2-7b5a-429b-8e5b-36233d002f68', 'ff029852-8290-4a43-8ec7-a1282c50feac', '03a411c1-bf7a-4927-b0f5-16a7bc4a96b5'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Delete snapshot completed successfully.
Jun 26 00:32:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-44e7ab4b-4cc8-418d-bafc-177d0adec055 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-56138ccb-a874-4af4-b665-ae9d181a07d8-delete_snapshot" released by "delete_snapshot" :: held 4.770s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "cinder-2a7c49c6-2850-4b80-aa50-5512000bc1ba-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-2a7c49c6-2850-4b80-aa50-5512000bc1ba-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "cinder-quobyte-2a7c49c6-2850-4b80-aa50-5512000bc1ba" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-quobyte-2a7c49c6-2850-4b80-aa50-5512000bc1ba" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[845cb1aa-aa54-4251-9d76-64b7e8e6a9b3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Creating offline snapshot 622aa16d-8d20-4ede-b6c1-3480d5f81bb7 of volume 1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c280a-eef8-4490-b21c-81517735101d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:32:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:38 devstack sudo[108854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba
Jun 26 00:32:38 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:39 devstack sudo[108855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:32:39 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:39 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba" returned: 0 in 1.175s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:39 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 1.122s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:40 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba
Jun 26 00:32:40 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:40 devstack sudo[108867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 1G
Jun 26 00:32:40 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:40 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2a7c49c6-2850-4b80-aa50-5512000bc1ba" returned: 0 in 0.833s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-quobyte-2a7c49c6-2850-4b80-aa50-5512000bc1ba" released by "delete_volume" :: held 2.112s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:40 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Created reservations ['775db774-7367-4df9-b18d-6916eef62b51', '285d0797-c085-4849-862c-b0982bfb377e', '0f80da99-22d4-4799-b3e0-668d559f1667', '621e2ca8-0022-4cfc-97b7-6521f5481a19'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:41 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 1G" returned: 0 in 1.130s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:41 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:32:41 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:41 devstack sudo[108876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7
Jun 26 00:32:41 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:42 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7" returned: 0 in 0.975s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:42 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 is being set with open permissions: ugo+rw
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:42 devstack sudo[108884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7
Jun 26 00:32:42 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:42 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.101s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:32:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Deleted volume successfully.
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6877be43-0959-481b-89c9-df32bbfcca43 tempest-SnapshotMetadataTestJSON-165578141 None] Lock "cinder-2a7c49c6-2850-4b80-aa50-5512000bc1ba-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:32:42 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7" returned: 0 in 0.783s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:42 devstack sudo[108887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info
Jun 26 00:32:42 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:43 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info" returned: 0 in 0.753s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:43 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info is being set with open permissions: ugo+rw
Jun 26 00:32:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:43 devstack sudo[108890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info
Jun 26 00:32:43 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:44 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.info" returned: 0 in 1.092s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.051s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:44 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c15f76bc-d862-4659-91b7-f463d8de97f1 tempest-TestStampPattern-934689577 None] Create snapshot completed successfully
Jun 26 00:32:54 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=78,cinder:UPDATE=68,cinder:INSERT=20,cinder:DELETE=3 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:32:54 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=63,cinder:UPDATE=65,cinder:INSERT=25,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Flow 'volume_create_manager' (0f3ae1c8-817e-4b33-98c3-ff9ae58228b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3263fc-8e1f-4838-804f-91292a86e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3263fc-8e1f-4838-804f-91292a86e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1435143497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8068e711-ed03-4c86-b8fc-cc51be91425f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f876afb5f453c8a8d0d94e7777bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:57Z,use_quota=True,user_id='cd004b998f2440d5ac79c4a4b9ee5561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c480536-15ff-4a3f-a733-b7e51f77bf2d),volume_type_id=5c480536-15ff-4a3f-a733-b7e51f77bf2d)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e419c9f1-0ef2-427a-b95f-d2c56d9d9b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e419c9f1-0ef2-427a-b95f-d2c56d9d9b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8514528c-8fac-441a-8fe2-faf00835e6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8514528c-8fac-441a-8fe2-faf00835e6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8068e711-ed03-4c86-b8fc-cc51be91425f', 'volume_name': 'volume-8068e711-ed03-4c86-b8fc-cc51be91425f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbe53a2-2f46-476a-9174-e8b4600e8d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbe53a2-2f46-476a-9174-e8b4600e8d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c30a61-3fff-4803-9792-e46ca661ba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Volume 8068e711-ed03-4c86-b8fc-cc51be91425f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8068e711-ed03-4c86-b8fc-cc51be91425f', 'volume_size': 1}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1435143497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8068e711-ed03-4c86-b8fc-cc51be91425f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f876afb5f453c8a8d0d94e7777bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:57Z,use_quota=True,user_id='cd004b998f2440d5ac79c4a4b9ee5561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c480536-15ff-4a3f-a733-b7e51f77bf2d),volume_type_id=5c480536-15ff-4a3f-a733-b7e51f77bf2d)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Creating volume 8068e711-ed03-4c86-b8fc-cc51be91425f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:32:56 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:32:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:56 devstack sudo[108950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f 1073741824
Jun 26 00:32:56 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Flow 'volume_create_manager' (655aa5c7-af80-497c-8556-b138fdffc1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102ba492-f2a3-4aeb-9954-335543fee699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102ba492-f2a3-4aeb-9954-335543fee699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2107521047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f876afb5f453c8a8d0d94e7777bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:57Z,use_quota=True,user_id='cd004b998f2440d5ac79c4a4b9ee5561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d63f4f80-dde1-4dbe-8437-5b1ced3a1f56),volume_type_id=d63f4f80-dde1-4dbe-8437-5b1ced3a1f56)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580cc1f7-0617-4778-8356-8d4e79e3adb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580cc1f7-0617-4778-8356-8d4e79e3adb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c75a204-5d8c-4ca6-88c5-58e5eeee40b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c75a204-5d8c-4ca6-88c5-58e5eeee40b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e', 'volume_name': 'volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6206e52c-9067-4de7-a7b0-073a3bcacd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6206e52c-9067-4de7-a7b0-073a3bcacd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12caa8fe-fc65-44d1-aa80-fde8b38e1a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Volume f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e', 'volume_size': 1}
Jun 26 00:32:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:58 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f 1073741824" returned: 0 in 1.768s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Flow 'volume_create_manager' (038bf054-7afc-4e77-a7ee-c0820d42a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0711cc6-318e-40a2-9d6a-d6d6c44bf378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0711cc6-318e-40a2-9d6a-d6d6c44bf378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2034962443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8ef581-dc0d-4b56-998f-66b1ca59f680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f876afb5f453c8a8d0d94e7777bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:58Z,use_quota=True,user_id='cd004b998f2440d5ac79c4a4b9ee5561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4a79d1c-2d69-497b-be59-1693e4b749bf),volume_type_id=a4a79d1c-2d69-497b-be59-1693e4b749bf)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4f651f-ac46-45b6-9ddb-131925420794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4f651f-ac46-45b6-9ddb-131925420794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7517c3bf-bc72-4ced-8c3f-48de95ee2c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:32:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:32:58 devstack sudo[108957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f
Jun 26 00:32:58 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Flow 'volume_create_manager' (abedf9e5-e0ff-4a18-a41e-7279bca3a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0f8cc0-cf17-44b8-9fca-e063afb5bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0f8cc0-cf17-44b8-9fca-e063afb5bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-49583407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e45a3e-1f9b-4972-8049-d5afd32d6b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e980a33dd79f4db9b9fcce315d68bdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=622aa16d-8d20-4ede-b6c1-3480d5f81bb7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:59Z,use_quota=True,user_id='e60749ff5a1b4accb5cd4893bb28193c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507e8f69-de85-4df1-88d8-b5b8ff5cef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507e8f69-de85-4df1-88d8-b5b8ff5cef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52235f1b-148a-45b0-a86d-ae64ff7e9f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52235f1b-148a-45b0-a86d-ae64ff7e9f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5e45a3e-1f9b-4972-8049-d5afd32d6b5e', 'volume_name': 'volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e', 'volume_size': 1, 'snapshot_id': '622aa16d-8d20-4ede-b6c1-3480d5f81bb7'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96e2066-aeb0-47ab-9d09-2c55192e8da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96e2066-aeb0-47ab-9d09-2c55192e8da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d26b77-b159-4c64-badc-0cecfd270878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Volume b5e45a3e-1f9b-4972-8049-d5afd32d6b5e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e', 'volume_size': 1, 'snapshot_id': '622aa16d-8d20-4ede-b6c1-3480d5f81bb7'}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7517c3bf-bc72-4ced-8c3f-48de95ee2c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b8ef581-dc0d-4b56-998f-66b1ca59f680', 'volume_name': 'volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680', 'volume_size': 1, 'image_id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1549242187', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a1f876afb5f453c8a8d0d94e7777bfa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'created_at': datetime.datetime(2026, 6, 25, 22, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459dfa0c0>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6d4693-7061-4ea9-b8c2-505a7e9ed92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6d4693-7061-4ea9-b8c2-505a7e9ed92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ac1531-7795-46cf-975f-d841edd1df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:32:59 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Volume 9b8ef581-dc0d-4b56-998f-66b1ca59f680: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680', 'volume_size': 1, 'image_id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1549242187', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a1f876afb5f453c8a8d0d94e7777bfa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'created_at': datetime.datetime(2026, 6, 25, 22, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459dfa0c0>}
Jun 26 00:32:59 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Trying to clone 9b8ef581-dc0d-4b56-998f-66b1ca59f680 from image a90edcf5-9cb7-4b4f-8271-bcae01f00445 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:33:00 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f" returned: 0 in 1.259s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] <== create_volume: return (3220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.223s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.440s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2107521047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f876afb5f453c8a8d0d94e7777bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:57Z,use_quota=True,user_id='cd004b998f2440d5ac79c4a4b9ee5561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d63f4f80-dde1-4dbe-8437-5b1ced3a1f56),volume_type_id=d63f4f80-dde1-4dbe-8437-5b1ced3a1f56)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Creating volume f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:00 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c30a61-3fff-4803-9792-e46ca661ba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8068e711-ed03-4c86-b8fc-cc51be91425f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:00 devstack sudo[108960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e 1073741824
Jun 26 00:33:00 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cbe2fd-0342-4caf-bf6f-0692445c3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Volume volume-8068e711-ed03-4c86-b8fc-cc51be91425f (8068e711-ed03-4c86-b8fc-cc51be91425f): created successfully
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cbe2fd-0342-4caf-bf6f-0692445c3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Flow 'volume_create_manager' (0f3ae1c8-817e-4b33-98c3-ff9ae58228b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-04b98a9f-a7b3-4253-bc22-b63a99bc76de tempest-TestInstancesWithCinderVolumes-768015916 None] Created volume successfully.
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:33:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:01 devstack sudo[108965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:33:01 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:01 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e 1073741824" returned: 0 in 1.722s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:01 devstack sudo[108977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e
Jun 26 00:33:01 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:02 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.516s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Flow 'volume_create_manager' (370648fb-541f-4c64-9d17-76d401cd3452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be945cc4-c54a-4764-a6a9-e2613cade164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be945cc4-c54a-4764-a6a9-e2613cade164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1059367789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dea7d12-12f4-4591-aff8-552b9a4b5eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c8f110ea34f9caa1e3859e32dc69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:03Z,use_quota=True,user_id='18e12ca9bad24fb690039bee65e6a412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643af86a-1431-4387-b4ae-b0c2aa309d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643af86a-1431-4387-b4ae-b0c2aa309d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24340eea-2e07-41dd-b994-0e20fb8b88a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24340eea-2e07-41dd-b994-0e20fb8b88a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dea7d12-12f4-4591-aff8-552b9a4b5eb8', 'volume_name': 'volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a9822f-826e-4673-9dde-07eb17eedf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a9822f-826e-4673-9dde-07eb17eedf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928a1742-a396-4564-847d-5b5ac6001802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8', 'volume_size': 1}
Jun 26 00:33:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:03 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" returned: 0 in 1.340s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] <== create_volume: return (3134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.137s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.907s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-quobyte-622aa16d-8d20-4ede-b6c1-3480d5f81bb7-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12caa8fe-fc65-44d1-aa80-fde8b38e1a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f209887-ebd6-4927-8f91-9cb81384037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-622aa16d-8d20-4ede-b6c1-3480d5f81bb7-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Creating volume b5e45a3e-1f9b-4972-8049-d5afd32d6b5e from snapshot 622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-quobyte-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Volume volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e (f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e): created successfully
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f209887-ebd6-4927-8f91-9cb81384037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Flow 'volume_create_manager' (655aa5c7-af80-497c-8556-b138fdffc1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (7110b460-8f68-42c2-9c94-981579d027d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e705801-9762-4164-bec9-4d92dc1bdc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] snapshot: 622aa16d-8d20-4ede-b6c1-3480d5f81bb7, volume: b5e45a3e-1f9b-4972-8049-d5afd32d6b5e,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:33:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fc4f6560-9b6a-4014-b388-9eed4ac6e345 tempest-TestInstancesWithCinderVolumes-768015916 None] Created volume successfully.
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e705801-9762-4164-bec9-4d92dc1bdc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1416125289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f0948e-754c-4e32-84d5-fa29ce5314b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:03Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bc1adc-dbff-4614-acdd-af2a6661197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bc1adc-dbff-4614-acdd-af2a6661197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7110431c-6041-4529-aa71-2bfe87a472e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7110431c-6041-4529-aa71-2bfe87a472e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f0948e-754c-4e32-84d5-fa29ce5314b7', 'volume_name': 'volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4af9dea-ca8a-49f3-8bea-4a17ead3d92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4af9dea-ca8a-49f3-8bea-4a17ead3d92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200460d1-912c-4e96-95a6-33a4b79956b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume a3f0948e-754c-4e32-84d5-fa29ce5314b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7', 'volume_size': 1}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f482b-f953-4ca4-9f76-9b0a183151c4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:03 devstack sudo[108981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7
Jun 26 00:33:03 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:04 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7" returned: 0 in 0.862s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:33:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:33:04 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba54d8-f862-46bf-8824-b67770d57433]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:04 devstack sudo[108990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:33:04 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:05 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:05 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:33:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:05 devstack sudo[108996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e
Jun 26 00:33:05 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:05 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD, size 20.69 MB, duration 5.65 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:33:05 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Image download 20.69 MB at 3.66 MB/s
Jun 26 00:33:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a907995d-60a3-4a61-98d9-1a2902e935ee]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:05 devstack sudo[108998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD
Jun 26 00:33:05 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:06 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:06 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Temporary image a90edcf5-9cb7-4b4f-8271-bcae01f00445 is fetched for user cd004b998f2440d5ac79c4a4b9ee5561. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:33:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e6c8b-2134-4736-9f40-42e4c7acfe8a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:07 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD
Jun 26 00:33:07 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:08 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD" returned: 0 in 2.042s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:12 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" returned: 0 in 6.900s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e141afd-961d-4f6b-9b49-49082d6acaa8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:12 devstack sudo[109021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:33:12 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:13 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.994s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:33:13 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Converted 1024.00 MB image at 148.39 MB/s
Jun 26 00:33:13 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e is being set with open permissions: ugo+rw
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:13 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e
Jun 26 00:33:13 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:13 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" returned: 0 in 0.654s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" released by "_copy_volume_from_snapshot" :: held 10.526s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-622aa16d-8d20-4ede-b6c1-3480d5f81bb7-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" released by "_create_volume_from_snapshot" :: held 10.604s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.661s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.004s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1059367789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dea7d12-12f4-4591-aff8-552b9a4b5eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c8f110ea34f9caa1e3859e32dc69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:03Z,use_quota=True,user_id='18e12ca9bad24fb690039bee65e6a412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Creating volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:13 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:13 devstack sudo[109054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 1073741824
Jun 26 00:33:13 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d26b77-b159-4c64-badc-0cecfd270878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e', 'volume_size': 1, 'snapshot_id': '622aa16d-8d20-4ede-b6c1-3480d5f81bb7'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcc8d4e-477c-44ca-af00-7837ade3ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Volume volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e (b5e45a3e-1f9b-4972-8049-d5afd32d6b5e): created successfully
Jun 26 00:33:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcc8d4e-477c-44ca-af00-7837ade3ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Flow 'volume_create_manager' (abedf9e5-e0ff-4a18-a41e-7279bca3a91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fc8a95f6-1a5a-4a7a-b884-ec48d20868f2 tempest-TestStampPattern-934689577 None] Created volume successfully.
Jun 26 00:33:14 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 1073741824" returned: 0 in 0.839s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:14 devstack sudo[109060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8
Jun 26 00:33:14 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:15 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" returned: 0 in 0.657s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.956s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1416125289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f0948e-754c-4e32-84d5-fa29ce5314b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:03Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating volume a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:15 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928a1742-a396-4564-847d-5b5ac6001802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f22cd8-f913-4a70-8eba-f2b89ef81789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:15 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 1073741824
Jun 26 00:33:15 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:15 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Volume volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 (4dea7d12-12f4-4591-aff8-552b9a4b5eb8): created successfully
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f22cd8-f913-4a70-8eba-f2b89ef81789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Flow 'volume_create_manager' (370648fb-541f-4c64-9d17-76d401cd3452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f7856c72-d412-47cd-a45c-6c00220701b5 tempest-SnapshotsActionsTest-2047747743 None] Created volume successfully.
Jun 26 00:33:16 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 1073741824" returned: 0 in 0.883s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:16 devstack sudo[109072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7
Jun 26 00:33:16 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:17 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7" returned: 0 in 0.647s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.360s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2034962443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8ef581-dc0d-4b56-998f-66b1ca59f680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f876afb5f453c8a8d0d94e7777bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:32:58Z,use_quota=True,user_id='cd004b998f2440d5ac79c4a4b9ee5561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4a79d1c-2d69-497b-be59-1693e4b749bf),volume_type_id=a4a79d1c-2d69-497b-be59-1693e4b749bf)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Creating volume 9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:17 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:17 devstack sudo[109089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 1073741824
Jun 26 00:33:17 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200460d1-912c-4e96-95a6-33a4b79956b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80131563-85e7-4557-9f9e-67da99b82d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:17 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 (a3f0948e-754c-4e32-84d5-fa29ce5314b7): created successfully
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80131563-85e7-4557-9f9e-67da99b82d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (7110b460-8f68-42c2-9c94-981579d027d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f56c99fc-b58b-45a3-8ae0-c1ddb4a73915 tempest-VolumesSnapshotTestJSON-1955336255 None] Created volume successfully.
Jun 26 00:33:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:18 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 1073741824" returned: 0 in 1.261s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:18 devstack sudo[109135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:33:18 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:19 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 0 in 0.716s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.700s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Creating offline snapshot 88da89a0-a37e-43f1-be2d-7e548d64f121 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Attempting download of a90edcf5-9cb7-4b4f-8271-bcae01f00445 ((None, [{'url': 'file:///opt/stack/data/glance/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'metadata': {}}])) to volume 9b8ef581-dc0d-4b56-998f-66b1ca59f680. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e624cdd-8b15-493b-a878-8ed1daa3a0fa]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3128d-f6c1-44e2-92d2-ee55de8870c8]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:19 devstack sudo[109140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8
Jun 26 00:33:19 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:19 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq
Jun 26 00:33:19 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:20 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq" returned: 0 in 0.886s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:20 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" returned: 0 in 1.000s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:20 devstack sudo[109151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 1G
Jun 26 00:33:20 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:20 devstack sudo[109150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq
Jun 26 00:33:20 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:21 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq" returned: 1 in 0.955s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a90edcf5-9cb7-4b4f-8271-bcae01f00445_qqsrbdjq' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:33:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab11b17-52a8-442a-8a1c-db8f3eba6c34]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:21 devstack sudo[109160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD
Jun 26 00:33:21 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:21 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 1G" returned: 0 in 1.301s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:21 devstack sudo[109162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:33:21 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:22 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:22 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] a90edcf5-9cb7-4b4f-8271-bcae01f00445 was qcow2, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:33:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:22 devstack sudo[109170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:33:22 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:22 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.901s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:22 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 is being set with open permissions: ugo+rw
Jun 26 00:33:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:22 devstack sudo[109174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:33:22 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:23 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.921s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:23 devstack sudo[109188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info
Jun 26 00:33:23 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:24 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info" returned: 0 in 0.807s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:24 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info is being set with open permissions: ugo+rw
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:24 devstack sudo[109192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info
Jun 26 00:33:24 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:24 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 0 in 2.262s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a90edcf5-9cb7-4b4f-8271-bcae01f00445_x6c1u76ndevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:33:24 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Converted 112.00 MB image at 49.46 MB/s
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:24 devstack sudo[109194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 1G
Jun 26 00:33:24 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:24 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.info" returned: 0 in 0.794s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.864s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.819s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating offline snapshot 247f29d8-9b46-4c0f-816c-3a951399c979 of volume a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0efb505-16e7-4d79-974d-167de28b8b5b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9728e709-cd4d-4bfc-aa20-2ba2f6ba0ea0 tempest-SnapshotsActionsTest-2047747743 None] Create snapshot completed successfully
Jun 26 00:33:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:25 devstack sudo[109199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7
Jun 26 00:33:25 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:25 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 1G" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ea27c-cfb3-4985-a5c7-075be12d9756]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:25 devstack sudo[109202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:33:25 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:26 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7" returned: 0 in 1.043s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:26 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 1G
Jun 26 00:33:26 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:26 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 0 in 0.999s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:26 devstack sudo[109247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:33:26 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:27 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 1G" returned: 0 in 1.021s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:27 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 1 in 0.890s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Downloaded image a90edcf5-9cb7-4b4f-8271-bcae01f00445 ((None, [{'url': 'file:///opt/stack/data/glance/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'metadata': {}}])) to volume 9b8ef581-dc0d-4b56-998f-66b1ca59f680 successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:33:27 devstack sudo[109255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Temporary image a90edcf5-9cb7-4b4f-8271-bcae01f00445 for user cd004b998f2440d5ac79c4a4b9ee5561 is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Marking volume 9b8ef581-dc0d-4b56-998f-66b1ca59f680 as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:33:27 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Copying metadata from image a90edcf5-9cb7-4b4f-8271-bcae01f00445 to 9b8ef581-dc0d-4b56-998f-66b1ca59f680. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Creating volume glance metadata for volume 9b8ef581-dc0d-4b56-998f-66b1ca59f680 backed by image a90edcf5-9cb7-4b4f-8271-bcae01f00445 with: {'image_id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'image_name': 'tempest-scenario-img--1549242187', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ac1531-7795-46cf-975f-d841edd1df8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680', 'volume_size': 1, 'image_id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1549242187', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a1f876afb5f453c8a8d0d94e7777bfa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a90edcf5-9cb7-4b4f-8271-bcae01f00445', 'created_at': datetime.datetime(2026, 6, 25, 22, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a90edcf5-9cb7-4b4f-8271-bcae01f00445/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459dfa0c0>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d874148-fd23-4d27-8857-237d1c6dd4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:27 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Volume volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 (9b8ef581-dc0d-4b56-998f-66b1ca59f680): created successfully
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d874148-fd23-4d27-8857-237d1c6dd4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Flow 'volume_create_manager' (038bf054-7afc-4e77-a7ee-c0820d42a4af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:27 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cadc1a05-e82f-4f0e-b613-7a7571f05f2a tempest-TestInstancesWithCinderVolumes-768015916 None] Created volume successfully.
Jun 26 00:33:27 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979" returned: 0 in 0.717s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:27 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 is being set with open permissions: ugo+rw
Jun 26 00:33:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:27 devstack sudo[109260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979
Jun 26 00:33:27 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:28 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979" returned: 0 in 0.663s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:28 devstack sudo[109263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info
Jun 26 00:33:28 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:29 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info" returned: 0 in 0.745s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:29 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info is being set with open permissions: ugo+rw
Jun 26 00:33:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:29 devstack sudo[109266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info
Jun 26 00:33:29 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:30 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.info" returned: 0 in 0.788s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.137s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.560s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Creating offline snapshot 959b133a-8c5f-4e3c-ab9d-5edba3630a4f of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90cc12-1053-41d1-be89-4d4b2d33f4a2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6bdf870c-f039-4dd5-b60e-a8a8d4199375 tempest-VolumesSnapshotTestJSON-1955336255 None] Create snapshot completed successfully
Jun 26 00:33:30 devstack sudo[109272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:33:30 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-247f29d8-9b46-4c0f-816c-3a951399c979-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-247f29d8-9b46-4c0f-816c-3a951399c979-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-a3f0948e-754c-4e32-84d5-fa29ce5314b7" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-a3f0948e-754c-4e32-84d5-fa29ce5314b7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-247f29d8-9b46-4c0f-816c-3a951399c979" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-247f29d8-9b46-4c0f-816c-3a951399c979" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Deleting offline snapshot 247f29d8-9b46-4c0f-816c-3a951399c979 of volume a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] snapshot_file for this snap is: volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f180f-3d92-4101-8146-f8342c73e208]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:31 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.971s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:31 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f 1G
Jun 26 00:33:31 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:31 devstack sudo[109290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979
Jun 26 00:33:31 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:31 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979" returned: 0 in 0.857s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d21888-7d97-4f6d-9938-fada9c74dac4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:32 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f 1G" returned: 0 in 0.894s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:32 devstack sudo[109301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f
Jun 26 00:33:32 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:32 devstack sudo[109300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7
Jun 26 00:33:32 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:32 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f" returned: 0 in 0.716s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:32 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f is being set with open permissions: ugo+rw
Jun 26 00:33:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:32 devstack sudo[109310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f
Jun 26 00:33:32 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:32 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7" returned: 0 in 0.806s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:32 devstack sudo[109312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979
Jun 26 00:33:32 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:33 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f" returned: 0 in 0.640s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:33 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6d3256b7-3288-497c-9b26-cfdcbe10d858 tempest-SnapshotsActionsTest-2047747743 None] Create snapshot completed successfully
Jun 26 00:33:33 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979" returned: 0 in 0.788s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:33 devstack sudo[109319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979
Jun 26 00:33:33 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-959b133a-8c5f-4e3c-ab9d-5edba3630a4f-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-959b133a-8c5f-4e3c-ab9d-5edba3630a4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-959b133a-8c5f-4e3c-ab9d-5edba3630a4f" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-959b133a-8c5f-4e3c-ab9d-5edba3630a4f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Deleting offline snapshot 959b133a-8c5f-4e3c-ab9d-5edba3630a4f of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] snapshot_file for this snap is: volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff1ae87-e418-4275-90c7-e172041b85e2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:34 devstack sudo[109322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f
Jun 26 00:33:34 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:34 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7.247f29d8-9b46-4c0f-816c-3a951399c979" returned: 0 in 0.723s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-247f29d8-9b46-4c0f-816c-3a951399c979" released by "_delete_snapshot" :: held 3.279s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-a3f0948e-754c-4e32-84d5-fa29ce5314b7" released by "delete_snapshot" :: held 3.305s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['2a85a985-4d49-4f69-80e4-a8f930d2f8e4', '00a055fb-face-497c-b80e-19a844bcff9e', 'f7126287-d6bf-4d88-b591-15b68d3b4788', 'e7931780-2011-4f4f-8014-03822005be15'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:33:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Delete snapshot completed successfully.
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3152105f-ae57-4fa2-ac97-23717d7f303c tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-247f29d8-9b46-4c0f-816c-3a951399c979-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:34 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f" returned: 0 in 0.841s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668fe49-87f5-45a6-b918-780ce367fcef]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:35 devstack sudo[109328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:33:35 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:33:35 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (015a68f8-b344-4b7a-afc4-32bd5e4b3080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6fc845-d321-4db9-a912-cc4026cd37bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.998s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6fc845-d321-4db9-a912-cc4026cd37bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497160035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa3f756-8370-472e-aac7-cb51085edae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:36Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:35 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f
Jun 26 00:33:35 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9af5053-6be2-4da8-9abe-4c3312955ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9af5053-6be2-4da8-9abe-4c3312955ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa9c1ef-dafe-4b99-bc83-d1fd90262044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa9c1ef-dafe-4b99-bc83-d1fd90262044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa3f756-8370-472e-aac7-cb51085edae3', 'volume_name': 'volume-efa3f756-8370-472e-aac7-cb51085edae3', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607b085e-693c-424d-b94b-e91609fa595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607b085e-693c-424d-b94b-e91609fa595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c1fe12-be1e-402a-bc50-ed833e415040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:36 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume efa3f756-8370-472e-aac7-cb51085edae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa3f756-8370-472e-aac7-cb51085edae3', 'volume_size': 1}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497160035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa3f756-8370-472e-aac7-cb51085edae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:36Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating volume efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:36 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:36 devstack sudo[109335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 1073741824
Jun 26 00:33:36 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:36 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f" returned: 0 in 0.976s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:36 devstack sudo[109353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f
Jun 26 00:33:36 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:37 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 1073741824" returned: 0 in 0.947s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:37 devstack sudo[109355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:33:37 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:37 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.959b133a-8c5f-4e3c-ab9d-5edba3630a4f" returned: 0 in 0.689s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-959b133a-8c5f-4e3c-ab9d-5edba3630a4f" released by "_delete_snapshot" :: held 3.616s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" released by "delete_snapshot" :: held 3.644s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Created reservations ['fb455fb4-9850-4ec7-9f6b-536bc39f420d', '8ec608ee-d46f-4b87-8ef5-d8b732df87e0', 'f5fdc5ed-a078-4de4-b23d-64661fe5ac5f', '7abda82a-3ce1-4dc2-b53e-11130c7584ac'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:33:37 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 0.692s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.383s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c1fe12-be1e-402a-bc50-ed833e415040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa3f756-8370-472e-aac7-cb51085edae3', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6b366b-7bf7-47b1-a6a1-d662d2727503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3106db48-c699-4c74-b55f-046511b295ca]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:37 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume volume-efa3f756-8370-472e-aac7-cb51085edae3 (efa3f756-8370-472e-aac7-cb51085edae3): created successfully
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6b366b-7bf7-47b1-a6a1-d662d2727503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (015a68f8-b344-4b7a-afc4-32bd5e4b3080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Delete snapshot completed successfully.
Jun 26 00:33:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d4522e6-6644-48f1-9b44-1199066674eb tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-959b133a-8c5f-4e3c-ab9d-5edba3630a4f-delete_snapshot" released by "delete_snapshot" :: held 3.857s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d2368041-dc98-4896-a2cb-e5c559f6db08 tempest-VolumesSnapshotTestJSON-1955336255 None] Created volume successfully.
Jun 26 00:33:37 devstack sudo[109359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:33:37 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:38 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 0 in 0.839s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:38 devstack sudo[109363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:33:38 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:39 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 1 in 0.789s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.670s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.293s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating offline snapshot ee57100d-0acd-4ff8-9721-e47a1cea5f24 of volume efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087a431-78a0-478f-9e44-e0ff50d82203]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10ea0b61-c402-4232-b6c3-48113ff88391', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:33:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-1029b04d-ef2a-4576-b36f-8d878f881b66 req-fa741704-3807-477a-9c28-9d46fd94b618 tempest-TestInstancesWithCinderVolumes-768015916 None] attachment_update completed successfully.
Jun 26 00:33:39 devstack sudo[109368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:33:39 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:40 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 0.799s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:40 devstack sudo[109373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 1G
Jun 26 00:33:40 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:41 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 1G" returned: 0 in 0.856s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3f756-8370-472e-aac7-cb51085edae3 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:41 devstack sudo[109378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3f756-8370-472e-aac7-cb51085edae3 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24
Jun 26 00:33:41 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:41 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3f756-8370-472e-aac7-cb51085edae3 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24" returned: 0 in 0.689s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:41 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 is being set with open permissions: ugo+rw
Jun 26 00:33:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:41 devstack sudo[109450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24
Jun 26 00:33:41 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:42 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24" returned: 0 in 0.676s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:42 devstack sudo[109453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info
Jun 26 00:33:42 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:43 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info" returned: 0 in 0.751s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:43 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info is being set with open permissions: ugo+rw
Jun 26 00:33:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:43 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info
Jun 26 00:33:43 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:43 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.info" returned: 0 in 0.670s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.546s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.435s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Creating offline snapshot 626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:33:44 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4ef9a6-7997-499c-9ef7-b26119af0ffe]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:44 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5f19278d-9825-42f6-9695-6d2bff8d8929 tempest-VolumesSnapshotTestJSON-1955336255 None] Create snapshot completed successfully
Jun 26 00:33:44 devstack sudo[109464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:33:44 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:45 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 1.030s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:45 devstack sudo[109792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 1G
Jun 26 00:33:45 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (cd441410-e8a7-49c6-8cb1-162549761b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3a79ce-8003-42d2-a005-6821bc9d4b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3a79ce-8003-42d2-a005-6821bc9d4b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1380125177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a4c245-ea04-4083-a5f1-8f58720e462d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:33:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ee57100d-0acd-4ff8-9721-e47a1cea5f24,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:33:45Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b1ebe7-11cc-4995-81f5-b7bef0272305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b1ebe7-11cc-4995-81f5-b7bef0272305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7c8e3c-40db-47b0-9458-f0092ffdc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7c8e3c-40db-47b0-9458-f0092ffdc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27a4c245-ea04-4083-a5f1-8f58720e462d', 'volume_name': 'volume-27a4c245-ea04-4083-a5f1-8f58720e462d', 'volume_size': 2, 'snapshot_id': 'ee57100d-0acd-4ff8-9721-e47a1cea5f24'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d50a74-2983-4b88-964d-4e5d951b7920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d50a74-2983-4b88-964d-4e5d951b7920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312808ff-2e44-4304-b779-11ee983cf492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:33:45 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Volume 27a4c245-ea04-4083-a5f1-8f58720e462d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27a4c245-ea04-4083-a5f1-8f58720e462d', 'volume_size': 2, 'snapshot_id': 'ee57100d-0acd-4ff8-9721-e47a1cea5f24'}
Jun 26 00:33:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:46 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 1G" returned: 0 in 1.306s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:46 devstack sudo[109869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3
Jun 26 00:33:46 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:47 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" returned: 0 in 0.850s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:47 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 is being set with open permissions: ugo+rw
Jun 26 00:33:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:47 devstack sudo[109879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3
Jun 26 00:33:47 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:48 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" returned: 0 in 0.767s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.709s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-ee57100d-0acd-4ff8-9721-e47a1cea5f24-27a4c245-ea04-4083-a5f1-8f58720e462d" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-ee57100d-0acd-4ff8-9721-e47a1cea5f24-27a4c245-ea04-4083-a5f1-8f58720e462d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Creating volume 27a4c245-ea04-4083-a5f1-8f58720e462d from snapshot ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-27a4c245-ea04-4083-a5f1-8f58720e462d" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a9c4e04a-4047-46ff-883e-00656293aa77 tempest-SnapshotsActionsTest-2047747743 None] Create snapshot completed successfully
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-27a4c245-ea04-4083-a5f1-8f58720e462d" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] snapshot: ee57100d-0acd-4ff8-9721-e47a1cea5f24, volume: 27a4c245-ea04-4083-a5f1-8f58720e462d,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89e546-bad4-4dab-b08e-0787cb7e73a3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:48 devstack sudo[109882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24
Jun 26 00:33:48 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-626ffceb-d0ca-4b77-bd88-4a827c3bd7c3-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-626ffceb-d0ca-4b77-bd88-4a827c3bd7c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:49 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24" returned: 0 in 1.070s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efa3f756-8370-472e-aac7-cb51085edae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[935abdb6-f6bb-49e8-bb63-7a6484f0c7ed]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Deleting offline snapshot 626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] snapshot_file for this snap is: volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6a4681-1ced-483e-af8a-be4497f7d32f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:33:49 devstack sudo[109896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:33:49 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:49 devstack sudo[109897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3
Jun 26 00:33:49 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:50 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 1.124s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:50 devstack sudo[109904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d
Jun 26 00:33:50 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:50 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" returned: 0 in 1.265s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b4bcd6-d322-444c-be25-ee4d10672ec1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:50 devstack sudo[109910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:33:50 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:52 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 1.297s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:33:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:52 devstack sudo[109929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3
Jun 26 00:33:52 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:54 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" returned: 0 in 2.363s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:54 devstack sudo[109952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3
Jun 26 00:33:54 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:57 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" returned: 0 in 2.684s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-626ffceb-d0ca-4b77-bd88-4a827c3bd7c3" released by "_delete_snapshot" :: held 7.863s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" released by "delete_snapshot" :: held 7.954s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=47,cinder:SELECT=51,cinder:DELETE=6,cinder:INSERT=12 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=72,cinder:UPDATE=37,cinder:INSERT=14,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Created reservations ['ee0a5cd3-ac72-473c-8b9a-b8fd9893fff6', 'b1810e65-f318-43e7-a659-8b97471d5ece', 'e11750b8-f2e4-4c2d-ac6a-eebba9ec6cda', 'f68ac70a-232d-4f4c-b020-597400f1c038'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:33:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Delete snapshot completed successfully.
Jun 26 00:33:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99dc7e0d-4f71-41b6-82c3-991fcfcd3482 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-626ffceb-d0ca-4b77-bd88-4a827c3bd7c3-delete_snapshot" released by "delete_snapshot" :: held 8.597s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:33:58 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root
Jun 26 00:33:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d" returned: 0 in 8.431s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:33:58 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ecd2d8-d1bb-4b57-8042-4e3c2fdf3f9d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:33:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:33:59 devstack sudo[109958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:33:59 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:33:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:00 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 1.294s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:34:00 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Converted 1024.00 MB image at 121.44 MB/s
Jun 26 00:34:00 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d is being set with open permissions: ugo+rw
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:00 devstack sudo[109964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d
Jun 26 00:34:00 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:01 devstack sudo[109968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:01 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:01 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d" returned: 0 in 0.913s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-27a4c245-ea04-4083-a5f1-8f58720e462d" released by "_copy_volume_from_snapshot" :: held 13.006s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-ee57100d-0acd-4ff8-9721-e47a1cea5f24-27a4c245-ea04-4083-a5f1-8f58720e462d" released by "_create_volume_from_snapshot" :: held 13.057s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.083s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.660s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[432a0136-aac5-4d67-8152-a707805f09c5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312808ff-2e44-4304-b779-11ee983cf492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a4c245-ea04-4083-a5f1-8f58720e462d', 'volume_size': 2, 'snapshot_id': 'ee57100d-0acd-4ff8-9721-e47a1cea5f24'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847c2e39-10a1-409e-9fff-652f2c88dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Volume volume-27a4c245-ea04-4083-a5f1-8f58720e462d (27a4c245-ea04-4083-a5f1-8f58720e462d): created successfully
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847c2e39-10a1-409e-9fff-652f2c88dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (cd441410-e8a7-49c6-8cb1-162549761b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9d24ddad-a7ad-46d0-a3aa-fad97e6ad23f tempest-VolumesSnapshotTestJSON-1955336255 None] Created volume successfully.
Jun 26 00:34:01 devstack sudo[109970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e
Jun 26 00:34:01 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-27a4c245-ea04-4083-a5f1-8f58720e462d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-27a4c245-ea04-4083-a5f1-8f58720e462d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-27a4c245-ea04-4083-a5f1-8f58720e462d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-27a4c245-ea04-4083-a5f1-8f58720e462d" acquired by "delete_volume" :: waited 0.045s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de33736-ba1b-420d-a113-89504d2abb8f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:01 devstack sudo[109999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d
Jun 26 00:34:01 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:02 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.257s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:34:02 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" returned: 0 in 1.322s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.351s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.255s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Creating offline snapshot 67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a0cf1-b7ac-4faf-a1de-8440b316e7b7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80a7134d-4f2d-4968-87b6-5c3420ff1ac7', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:34:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-9917af8d-83fa-42a9-adc3-4caaa1b8ee44 req-647b268e-9f09-488d-bb75-8a6414a579ad tempest-TestStampPattern-934689577 None] attachment_update completed successfully.
Jun 26 00:34:02 devstack sudo[110009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:02 devstack sudo[110009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:02 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d" returned: 0 in 1.101s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:02 devstack sudo[110014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d
Jun 26 00:34:02 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:03 devstack sudo[110009]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.975s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:03 devstack sudo[110022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 1G
Jun 26 00:34:03 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:03 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-27a4c245-ea04-4083-a5f1-8f58720e462d" returned: 0 in 0.810s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-27a4c245-ea04-4083-a5f1-8f58720e462d" released by "delete_volume" :: held 1.997s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['68b008a8-58ff-47b6-9810-8074aae72d17', 'a0586776-80fe-4007-b1df-cfaf2645d976', '1bda84ee-6609-4c06-b7f0-054485289023', '1c6ed973-d285-41f8-a014-dc999fcab3b3'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:03 devstack sudo[110027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:03 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:04 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 1G" returned: 0 in 1.107s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:04 devstack sudo[110102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3
Jun 26 00:34:04 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:04 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.896s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:04 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleted volume successfully.
Jun 26 00:34:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b93496a4-8f8d-48e2-aac6-3f3c7da75840 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-27a4c245-ea04-4083-a5f1-8f58720e462d-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-ee57100d-0acd-4ff8-9721-e47a1cea5f24-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-ee57100d-0acd-4ff8-9721-e47a1cea5f24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-efa3f756-8370-472e-aac7-cb51085edae3" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-efa3f756-8370-472e-aac7-cb51085edae3" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-ee57100d-0acd-4ff8-9721-e47a1cea5f24" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-ee57100d-0acd-4ff8-9721-e47a1cea5f24" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleting offline snapshot ee57100d-0acd-4ff8-9721-e47a1cea5f24 of volume efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] snapshot_file for this snap is: volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e663445-c59d-4796-9e79-45b7da33890f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:05 devstack sudo[110104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24
Jun 26 00:34:05 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:05 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" returned: 0 in 0.824s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:05 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 is being set with open permissions: ugo+rw
Jun 26 00:34:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:05 devstack sudo[110109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3
Jun 26 00:34:05 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:06 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24" returned: 0 in 0.871s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efa3f756-8370-472e-aac7-cb51085edae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae0de3d-ed2a-423d-9d57-84787ac6d1b8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:06 devstack sudo[110114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:34:06 devstack sudo[110114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:06 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" returned: 0 in 0.686s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.710s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:06 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ae8f62b0-6c34-4944-ad41-c49d9fc628f7 tempest-SnapshotsActionsTest-2047747743 None] Create snapshot completed successfully
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:06 devstack sudo[110114]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 0.791s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:06 devstack sudo[110120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24
Jun 26 00:34:06 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Deleting offline snapshot 67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] snapshot_file for this snap is: volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d641d507-d3e3-46ea-a4b4-32ffbe0467f2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:07 devstack sudo[110122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3
Jun 26 00:34:07 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:07 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24" returned: 0 in 0.846s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:07 devstack sudo[110136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24
Jun 26 00:34:07 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:07 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" returned: 0 in 0.812s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9279f43-6867-4a7c-8e0d-924ca5078721]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:07 devstack sudo[110140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:07 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:08 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3.ee57100d-0acd-4ff8-9721-e47a1cea5f24" returned: 0 in 0.697s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-ee57100d-0acd-4ff8-9721-e47a1cea5f24" released by "_delete_snapshot" :: held 3.320s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-efa3f756-8370-472e-aac7-cb51085edae3" released by "delete_snapshot" :: held 3.350s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['37df44d5-d76a-4b46-9566-d573d9804978', '965b9563-171a-432d-b00b-aabdaf4b17d0', '18ef6b03-89c3-4fbb-9d99-11239f0d92ce', '9d6baf05-4701-42f7-84f0-6162bc437149'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Delete snapshot completed successfully.
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-099e3508-61e0-4f3c-bf57-a5ce4bfc6a68 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-ee57100d-0acd-4ff8-9721-e47a1cea5f24-delete_snapshot" released by "delete_snapshot" :: held 3.545s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:08 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.840s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:08 devstack sudo[110156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3
Jun 26 00:34:08 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-efa3f756-8370-472e-aac7-cb51085edae3-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-efa3f756-8370-472e-aac7-cb51085edae3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:09 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" returned: 0 in 0.815s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-efa3f756-8370-472e-aac7-cb51085edae3" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:09 devstack sudo[110162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3
Jun 26 00:34:09 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-efa3f756-8370-472e-aac7-cb51085edae3" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e707f39-4a11-4916-9ede-eab3a3e3be33]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:09 devstack sudo[110164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:34:09 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:10 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" returned: 0 in 0.701s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3" released by "_delete_snapshot" :: held 3.275s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" released by "delete_snapshot" :: held 3.302s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-1d5126b5-6f83-4ee0-930a-181034fa7b04 req-0fa9d835-a3b4-4d92-b819-4b3cd804df1a tempest-TestStampPattern-934689577 None] Terminate volume connection completed successfully.
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-1d5126b5-6f83-4ee0-930a-181034fa7b04 req-0fa9d835-a3b4-4d92-b819-4b3cd804df1a tempest-TestStampPattern-934689577 None] Deleting attachment 80a7134d-4f2d-4968-87b6-5c3420ff1ac7. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Created reservations ['d68a273a-4738-4818-909c-d7e1b7a91a4d', 'e1423602-90fc-4e3e-9dda-dbba8ca03308', '42c8e1c3-e8ac-4f2c-bda9-ec6f5efc82cb', '66dccf40-8884-4908-891b-22e81fb58822'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Delete snapshot completed successfully.
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59082d63-07cb-4159-974e-a1163f1b4d36 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-67a2f4e9-99d4-4f27-90a8-5ae94de7f8e3-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:10 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 0.855s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:10 devstack sudo[110176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3
Jun 26 00:34:10 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:11 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-efa3f756-8370-472e-aac7-cb51085edae3" returned: 0 in 0.675s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-efa3f756-8370-472e-aac7-cb51085edae3" released by "delete_volume" :: held 1.592s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['84cf3334-540b-4ba5-a146-22d3ca1f8a63', 'de479ca5-ef93-4f4d-9cd8-122422fb4790', 'c373eafc-3fd0-42dd-bdda-ab86d4b1b57b', 'cc94006a-c5ad-45dc-8181-001bcb58ee47'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:11 devstack sudo[110179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:11 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Creating offline snapshot 4aac95ab-02db-4329-b187-b30789e0cc05 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[75893177-1126-4b05-898c-4faf6b6f472e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:11 devstack sudo[110181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:11 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:11 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.737s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleted volume successfully.
Jun 26 00:34:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f4c0d35c-a855-42fb-b865-fd45d64c4432 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-efa3f756-8370-472e-aac7-cb51085edae3-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (ea14d6dc-2d0b-43f7-a2a1-8a0d590ab18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ddc19b-1c83-44e8-91e3-47838b0d5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ddc19b-1c83-44e8-91e3-47838b0d5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-223328286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965fce77-5167-46b7-829e-d8975a4b58e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:12Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a52375-e0e4-40d5-8d2d-db424afcd548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a52375-e0e4-40d5-8d2d-db424afcd548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866bd8ca-e0eb-4724-835b-a58966a8bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866bd8ca-e0eb-4724-835b-a58966a8bc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965fce77-5167-46b7-829e-d8975a4b58e8', 'volume_name': 'volume-965fce77-5167-46b7-829e-d8975a4b58e8', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73048025-b330-4972-9609-675e87c1d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73048025-b330-4972-9609-675e87c1d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2848e316-5e23-4dab-81ed-38a3351756ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:12 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume 965fce77-5167-46b7-829e-d8975a4b58e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965fce77-5167-46b7-829e-d8975a4b58e8', 'volume_size': 1}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:12 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 1.005s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:12 devstack sudo[110187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 1G
Jun 26 00:34:12 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:13 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 1G" returned: 0 in 1.079s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:13 devstack sudo[110195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05
Jun 26 00:34:13 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:14 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05" returned: 0 in 0.940s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:14 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 is being set with open permissions: ugo+rw
Jun 26 00:34:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:14 devstack sudo[110222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05
Jun 26 00:34:14 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:15 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05" returned: 0 in 0.913s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.045s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.046s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-223328286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965fce77-5167-46b7-829e-d8975a4b58e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:12Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating volume 965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:34:15 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:15 devstack sudo[110253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 1073741824
Jun 26 00:34:15 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-075068b8-5662-48fa-8432-32dd2dc40e09 tempest-SnapshotsActionsTest-2047747743 None] Create snapshot completed successfully
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-4aac95ab-02db-4329-b187-b30789e0cc05-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-4aac95ab-02db-4329-b187-b30789e0cc05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Acquiring lock "cinder-quobyte-4aac95ab-02db-4329-b187-b30789e0cc05" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4aac95ab-02db-4329-b187-b30789e0cc05" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Deleting offline snapshot 4aac95ab-02db-4329-b187-b30789e0cc05 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] snapshot_file for this snap is: volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4d3201-548d-494c-ab66-274e1aef265d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:15 devstack sudo[110256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05
Jun 26 00:34:15 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:16 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 1073741824" returned: 0 in 1.062s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:16 devstack sudo[110263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:16 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:16 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05" returned: 0 in 0.920s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f073c-94a6-49fe-84e3-e1a751a2ee2e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:16 devstack sudo[110268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:16 devstack sudo[110268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:17 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 0.671s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2848e316-5e23-4dab-81ed-38a3351756ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965fce77-5167-46b7-829e-d8975a4b58e8', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b27d536-5333-4f68-abd8-68ea872dffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:17 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume volume-965fce77-5167-46b7-829e-d8975a4b58e8 (965fce77-5167-46b7-829e-d8975a4b58e8): created successfully
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b27d536-5333-4f68-abd8-68ea872dffb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (ea14d6dc-2d0b-43f7-a2a1-8a0d590ab18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-af0493d5-43f6-498b-b0fd-a353ca9449d4 tempest-VolumesSnapshotTestJSON-1955336255 None] Created volume successfully.
Jun 26 00:34:17 devstack sudo[110268]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.849s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:17 devstack sudo[110274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05
Jun 26 00:34:17 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating offline snapshot 20620f9d-c61e-44ab-8afc-ff3f3827b5fc of volume 965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c86b5c7-8b4d-4734-af88-aecd22e9d8d2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:18 devstack sudo[110276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:18 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:18 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05" returned: 0 in 0.916s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:18 devstack sudo[110292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05
Jun 26 00:34:18 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:18 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 0.840s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:18 devstack sudo[110294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc 1G
Jun 26 00:34:18 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:19 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.4aac95ab-02db-4329-b187-b30789e0cc05" returned: 0 in 0.690s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4aac95ab-02db-4329-b187-b30789e0cc05" released by "_delete_snapshot" :: held 3.509s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" released by "delete_snapshot" :: held 3.539s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Created reservations ['6e0a738f-6bde-4135-aba3-90a1e16632b5', '312af5f5-1d08-4aa1-bde5-a28808a6c870', '3dc3b6ec-08da-46c7-89ee-c307f620565f', '24e31bc3-bb33-41af-ad6e-5a3406fe44ab'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Delete snapshot completed successfully.
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a679d551-5f51-4b47-bc50-6d5aec986c95 tempest-SnapshotsActionsTest-1522273061 None] Lock "cinder-4aac95ab-02db-4329-b187-b30789e0cc05-delete_snapshot" released by "delete_snapshot" :: held 3.694s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:19 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc 1G" returned: 0 in 0.834s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965fce77-5167-46b7-829e-d8975a4b58e8 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:19 devstack sudo[110301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965fce77-5167-46b7-829e-d8975a4b58e8 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc
Jun 26 00:34:19 devstack sudo[110301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Lock "cinder-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-quobyte-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e886cab-7400-4fb3-8266-d6de7516cbc6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:20 devstack sudo[110303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e
Jun 26 00:34:20 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:20 devstack sudo[110301]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965fce77-5167-46b7-829e-d8975a4b58e8 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc" returned: 0 in 0.823s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:20 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc is being set with open permissions: ugo+rw
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:20 devstack sudo[110308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc
Jun 26 00:34:20 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "cinder-88da89a0-a37e-43f1-be2d-7e548d64f121-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-88da89a0-a37e-43f1-be2d-7e548d64f121-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "cinder-quobyte-88da89a0-a37e-43f1-be2d-7e548d64f121" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-quobyte-88da89a0-a37e-43f1-be2d-7e548d64f121" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Deleting offline snapshot 88da89a0-a37e-43f1-be2d-7e548d64f121 of volume 4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] snapshot_file for this snap is: volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff826c3-ac28-4107-a01f-a224fda020b6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:20 devstack sudo[110310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:20 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:20 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" returned: 0 in 0.879s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:20 devstack sudo[110315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e
Jun 26 00:34:20 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:21 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc" returned: 0 in 0.740s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:21 devstack sudo[110318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info
Jun 26 00:34:21 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:21 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.803s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0684f4-b952-4ab6-92c4-4d3efdeec964]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:21 devstack sudo[110323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8
Jun 26 00:34:21 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:21 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" returned: 0 in 0.754s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e" released by "delete_volume" :: held 1.691s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Created reservations ['de1109ef-441e-4be3-a177-1ad3a60adb02', '59a5c00d-2e4c-442a-a06c-471c92958f41', 'b8ba724e-99cd-4ce2-b4d9-4ce45b0e7472', '17c70053-2fb8-447a-b678-68b2725ea19a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:21 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info" returned: 0 in 0.700s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:21 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info is being set with open permissions: ugo+rw
Jun 26 00:34:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:21 devstack sudo[110327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:21 devstack sudo[110327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:21 devstack sudo[110328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info
Jun 26 00:34:21 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:22 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" returned: 0 in 0.820s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:22 devstack sudo[110335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:22 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-622aa16d-8d20-4ede-b6c1-3480d5f81bb7-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Lock "cinder-622aa16d-8d20-4ede-b6c1-3480d5f81bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-quobyte-1174c2b3-e379-4ccb-b724-187bd72ee0a9" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-1174c2b3-e379-4ccb-b724-187bd72ee0a9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-quobyte-622aa16d-8d20-4ede-b6c1-3480d5f81bb7" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-622aa16d-8d20-4ede-b6c1-3480d5f81bb7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Deleting offline snapshot 622aa16d-8d20-4ede-b6c1-3480d5f81bb7 of volume 1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:34:22 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] snapshot_file for this snap is: volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:34:22 devstack sudo[110327]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.info" returned: 0 in 0.826s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.855s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab432faa-cc66-4827-a451-09829caf061a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.203s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.891s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9989333-15c9-4ec3-8561-c6955779b1b5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Deleted volume successfully.
Jun 26 00:34:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d691f9d8-689c-45fc-b10c-0584dbd98611 tempest-VolumesSnapshotTestJSON-1955336255 None] Create snapshot completed successfully
Jun 26 00:34:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a03ea626-d95e-4a20-8eac-cf18b8ef33c9 tempest-TestStampPattern-934689577 None] Lock "cinder-b5e45a3e-1f9b-4972-8049-d5afd32d6b5e-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:22 devstack sudo[110339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7
Jun 26 00:34:22 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:22 devstack sudo[110340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f
Jun 26 00:34:22 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:23 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:23 devstack sudo[110346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121
Jun 26 00:34:23 devstack sudo[110346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:23 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7" returned: 0 in 0.977s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:23 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b9db87-a2be-462a-8e3c-c0fb15e50a07]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f" returned: 0 in 0.998s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.044s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-8068e711-ed03-4c86-b8fc-cc51be91425f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94a3799b-5b4a-4d39-ac67-e86c6c641991', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (af4fa027-a983-4bc8-8f30-c81d34ba9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0068c4b5-1b1c-4f8b-bcac-d94bb6f639e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:23 devstack sudo[110354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:34:23 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0068c4b5-1b1c-4f8b-bcac-d94bb6f639e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-49195880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad0c2d9-144e-49bd-903e-038b21418126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869782969ae34b0c8cc91638f0354e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20620f9d-c61e-44ab-8afc-ff3f3827b5fc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:24Z,use_quota=True,user_id='e016313639d34639b2b60d33b1e26d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6b415-5b75-4e49-9734-9958d0fa359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6b415-5b75-4e49-9734-9958d0fa359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f1d397-dba7-450d-a05d-f830a1bd560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f1d397-dba7-450d-a05d-f830a1bd560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ad0c2d9-144e-49bd-903e-038b21418126', 'volume_name': 'volume-8ad0c2d9-144e-49bd-903e-038b21418126', 'volume_size': 1, 'snapshot_id': '20620f9d-c61e-44ab-8afc-ff3f3827b5fc'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3b5534-8d56-439d-9684-5bc1d3af600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3b5534-8d56-439d-9684-5bc1d3af600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9e6700-1a36-4414-80eb-f695dee3e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:23 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume 8ad0c2d9-144e-49bd-903e-038b21418126: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ad0c2d9-144e-49bd-903e-038b21418126', 'volume_size': 1, 'snapshot_id': '20620f9d-c61e-44ab-8afc-ff3f3827b5fc'}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-20620f9d-c61e-44ab-8afc-ff3f3827b5fc-8ad0c2d9-144e-49bd-903e-038b21418126" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-20620f9d-c61e-44ab-8afc-ff3f3827b5fc-8ad0c2d9-144e-49bd-903e-038b21418126" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating volume 8ad0c2d9-144e-49bd-903e-038b21418126 from snapshot 20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-8ad0c2d9-144e-49bd-903e-038b21418126" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:23 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-4001d729-f4d7-463e-aa49-ab14d5548752 req-e72a46dd-a3fb-4a00-83c2-6fc5b18bed78 tempest-TestInstancesWithCinderVolumes-768015916 None] attachment_update completed successfully.
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-8ad0c2d9-144e-49bd-903e-038b21418126" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] snapshot: 20620f9d-c61e-44ab-8afc-ff3f3827b5fc, volume: 8ad0c2d9-144e-49bd-903e-038b21418126,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aed44d-11b8-49be-9248-ac5aeead40c4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:24 devstack sudo[110346]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8.88da89a0-a37e-43f1-be2d-7e548d64f121" returned: 0 in 0.848s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-quobyte-88da89a0-a37e-43f1-be2d-7e548d64f121" released by "_delete_snapshot" :: held 3.501s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" released by "delete_snapshot" :: held 3.526s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:24 devstack sudo[110358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc
Jun 26 00:34:24 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Created reservations ['b63655e0-a2b0-4ac2-9881-273d5b8b5e13', 'fe2f9620-66c1-45cf-96a0-4f71023acf28', 'b83e161c-6e27-4c52-9a13-0d1366abd1ff', '0caf8294-4c1a-4ae7-9d7d-40dc9e0e68ca'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Delete snapshot completed successfully.
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b7dca0af-546b-414e-8fd9-dc107c3f14d5 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-88da89a0-a37e-43f1-be2d-7e548d64f121-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:24 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.829s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:24 devstack sudo[110363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7
Jun 26 00:34:24 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:24 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "cinder-4dea7d12-12f4-4591-aff8-552b9a4b5eb8-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc" returned: 0 in 0.843s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965fce77-5167-46b7-829e-d8975a4b58e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-4dea7d12-12f4-4591-aff8-552b9a4b5eb8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f3b353-bc0d-4409-9a24-50f2c3bd2123]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04a2796-54dd-404a-b289-ec6453b61e0d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:25 devstack sudo[110368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:25 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:25 devstack sudo[110371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8
Jun 26 00:34:25 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:25 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7" returned: 0 in 0.909s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:25 devstack sudo[110381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7
Jun 26 00:34:25 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:25 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 0.890s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:34:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:25 devstack sudo[110394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126
Jun 26 00:34:25 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:26 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" returned: 0 in 0.983s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:26 devstack sudo[110425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8
Jun 26 00:34:26 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:26 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9.622aa16d-8d20-4ede-b6c1-3480d5f81bb7" returned: 0 in 0.771s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-622aa16d-8d20-4ede-b6c1-3480d5f81bb7" released by "_delete_snapshot" :: held 3.646s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-1174c2b3-e379-4ccb-b724-187bd72ee0a9" released by "delete_snapshot" :: held 3.673s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Created reservations ['30fd2c16-5c81-4463-90c5-9efba575afb8', '9c4c9d11-9a81-4430-b5c7-a332e2d4355b', '0dd60995-6da5-419e-9825-e4acc7c9f455', '02590ec9-73ca-41cb-b614-9cd735239fed'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Delete snapshot completed successfully.
Jun 26 00:34:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f438b32c-3057-42e6-864f-b2ee7f118d67 tempest-TestStampPattern-934689577 None] Lock "cinder-622aa16d-8d20-4ede-b6c1-3480d5f81bb7-delete_snapshot" released by "delete_snapshot" :: held 3.840s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:27 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" returned: 0 in 1.006s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-quobyte-4dea7d12-12f4-4591-aff8-552b9a4b5eb8" released by "delete_volume" :: held 2.106s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Created reservations ['ccb7ca41-f705-477c-bb4c-706036f12c37', '55f7b96f-96ef-4baa-aac7-e08917f59245', '0a0d5fd1-c88d-466e-ad9d-5bdc2b7e7021', 'b0fd318b-6289-4437-87a7-9498e5b98a00'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:27 devstack sudo[110441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:27 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:28 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.349s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:28 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:28 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Deleted volume successfully.
Jun 26 00:34:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9fbfecc9-f5e3-4bb9-80ee-9bc20765c996 tempest-SnapshotsActionsTest-2047747743 None] Lock "cinder-4dea7d12-12f4-4591-aff8-552b9a4b5eb8-delete_volume" released by "delete_volume" :: held 4.032s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:32 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126" returned: 0 in 6.661s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:32 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7cbbaa-60ce-403f-ab08-6c7db9ac51c5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:32 devstack sudo[110500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:32 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:33 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 1.166s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:33 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:34:33 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Converted 1024.00 MB image at 153.71 MB/s
Jun 26 00:34:33 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 is being set with open permissions: ugo+rw
Jun 26 00:34:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:33 devstack sudo[110507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126
Jun 26 00:34:33 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:34 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-8ad0c2d9-144e-49bd-903e-038b21418126" released by "_copy_volume_from_snapshot" :: held 10.544s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-20620f9d-c61e-44ab-8afc-ff3f3827b5fc-8ad0c2d9-144e-49bd-903e-038b21418126" released by "_create_volume_from_snapshot" :: held 10.592s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.620s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.412s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9245655e-2414-4241-b948-46b5907094b4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9e6700-1a36-4414-80eb-f695dee3e62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad0c2d9-144e-49bd-903e-038b21418126', 'volume_size': 1, 'snapshot_id': '20620f9d-c61e-44ab-8afc-ff3f3827b5fc'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb1957f-f3ee-4638-bba6-2e831553d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Volume volume-8ad0c2d9-144e-49bd-903e-038b21418126 (8ad0c2d9-144e-49bd-903e-038b21418126): created successfully
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb1957f-f3ee-4638-bba6-2e831553d00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Flow 'volume_create_manager' (af4fa027-a983-4bc8-8f30-c81d34ba9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ef976bbe-8926-462b-8003-0c4dfb397a93 tempest-VolumesSnapshotTestJSON-1955336255 None] Created volume successfully.
Jun 26 00:34:34 devstack sudo[110520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e
Jun 26 00:34:34 devstack sudo[110520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-8ad0c2d9-144e-49bd-903e-038b21418126-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-8ad0c2d9-144e-49bd-903e-038b21418126-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-8ad0c2d9-144e-49bd-903e-038b21418126" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-8ad0c2d9-144e-49bd-903e-038b21418126" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fdfda5-874d-4a66-b58d-bd46ab0c9cb8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:35 devstack sudo[110520]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" returned: 0 in 0.931s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.955s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4c9b7ad-2ce8-4d33-a073-2261dd1a5de7', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:34:35 devstack sudo[110525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126
Jun 26 00:34:35 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:35 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-4bf30f08-ffe8-4f5f-ad6c-614fa1b895e3 req-21b05dd9-270f-440c-849d-858be996d56e tempest-TestInstancesWithCinderVolumes-768015916 None] attachment_update completed successfully.
Jun 26 00:34:36 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126" returned: 0 in 0.844s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:36 devstack sudo[110530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126
Jun 26 00:34:36 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:36 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8ad0c2d9-144e-49bd-903e-038b21418126" returned: 0 in 0.714s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-8ad0c2d9-144e-49bd-903e-038b21418126" released by "delete_volume" :: held 1.606s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['24505312-42c4-40f5-a44a-c1d3ffd3a73d', '8a9e3083-935a-4868-9333-a62863d00d78', '9d509595-6eb2-49f6-8982-1620c91bfbf6', '8f6b5a25-03d4-4fb8-9c85-c2cf95dfc4fa'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:37 devstack sudo[110538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:37 devstack sudo[110538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-20620f9d-c61e-44ab-8afc-ff3f3827b5fc-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-20620f9d-c61e-44ab-8afc-ff3f3827b5fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-965fce77-5167-46b7-829e-d8975a4b58e8" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-965fce77-5167-46b7-829e-d8975a4b58e8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-20620f9d-c61e-44ab-8afc-ff3f3827b5fc" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-20620f9d-c61e-44ab-8afc-ff3f3827b5fc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleting offline snapshot 20620f9d-c61e-44ab-8afc-ff3f3827b5fc of volume 965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] snapshot_file for this snap is: volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-1174c2b3-e379-4ccb-b724-187bd72ee0a9-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ed65b-9bee-4cd3-a998-212b63684182]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Lock "cinder-1174c2b3-e379-4ccb-b724-187bd72ee0a9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Acquiring lock "cinder-quobyte-1174c2b3-e379-4ccb-b724-187bd72ee0a9" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-1174c2b3-e379-4ccb-b724-187bd72ee0a9" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b27492-2735-44bc-9c35-97bf71567e93]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:37 devstack sudo[110540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc
Jun 26 00:34:37 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:37 devstack sudo[110538]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.700s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleted volume successfully.
Jun 26 00:34:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-94a64f44-1563-4692-94e9-8d1c634f98a8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-8ad0c2d9-144e-49bd-903e-038b21418126-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:38 devstack sudo[110542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:34:38 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:38 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc" returned: 0 in 0.848s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965fce77-5167-46b7-829e-d8975a4b58e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:34:38 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd42a5b-eb4b-4067-9758-50dba0d90b8b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:38 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.855s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:38 devstack sudo[110551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:38 devstack sudo[110551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:38 devstack sudo[110552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9
Jun 26 00:34:38 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:39 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1174c2b3-e379-4ccb-b724-187bd72ee0a9" returned: 0 in 0.774s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Lock "cinder-quobyte-1174c2b3-e379-4ccb-b724-187bd72ee0a9" released by "delete_volume" :: held 1.704s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:39 devstack sudo[110551]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 0.916s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:39 devstack sudo[110559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc
Jun 26 00:34:39 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Created reservations ['dfe3737f-e605-4311-bf88-d6ecf62055bf', '88a704b6-907b-4073-aa4e-8ce805d5c867', '8b252fa1-5fdf-48b6-bdc0-814567e2f333', '6618e5d5-1b9c-4a36-9074-52a917ab59cc'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:39 devstack sudo[110561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:39 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:40 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc" returned: 0 in 0.903s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:40 devstack sudo[110574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc
Jun 26 00:34:40 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:40 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.855s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:40 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:40 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Deleted volume successfully.
Jun 26 00:34:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-99501680-5218-4ab2-87fe-dad99666ea9a tempest-TestStampPattern-934689577 None] Lock "cinder-1174c2b3-e379-4ccb-b724-187bd72ee0a9-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:41 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8.20620f9d-c61e-44ab-8afc-ff3f3827b5fc" returned: 0 in 0.916s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-20620f9d-c61e-44ab-8afc-ff3f3827b5fc" released by "_delete_snapshot" :: held 3.736s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-965fce77-5167-46b7-829e-d8975a4b58e8" released by "delete_snapshot" :: held 3.763s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:41 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['92e674e6-7de8-42e6-b3f6-2eb8e4e9b952', 'c436e551-ed93-4ae5-afb6-54cfa7be144c', '393657ab-ff89-4da0-ba06-fc970050e3aa', '9b13fa84-dcbe-43c2-8374-3d7d867b4af1'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Delete snapshot completed successfully.
Jun 26 00:34:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9b62a21-7edb-4e64-bbd0-d3109cd2e715 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-20620f9d-c61e-44ab-8afc-ff3f3827b5fc-delete_snapshot" released by "delete_snapshot" :: held 3.975s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-965fce77-5167-46b7-829e-d8975a4b58e8-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-965fce77-5167-46b7-829e-d8975a4b58e8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-965fce77-5167-46b7-829e-d8975a4b58e8" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-965fce77-5167-46b7-829e-d8975a4b58e8" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:42 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a14a3e-be71-4019-98e2-9fa8e025d0f7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:42 devstack sudo[110579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:42 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:43 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 1.071s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:43 devstack sudo[110594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8
Jun 26 00:34:43 devstack sudo[110594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:44 devstack sudo[110594]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-965fce77-5167-46b7-829e-d8975a4b58e8" returned: 0 in 0.846s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-965fce77-5167-46b7-829e-d8975a4b58e8" released by "delete_volume" :: held 2.015s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['cd43a8f2-020e-44fe-b8be-3f5e24a7be86', '700debe2-afd5-4d82-851e-b6f3485b3cb2', '26865de0-e26c-4286-8a2b-cdef40168c0f', '9dce7685-a939-431d-8567-5943e35e255c'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:44 devstack sudo[110612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:44 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:45 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.923s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:45 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleted volume successfully.
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1d9b164f-fe22-41aa-8b58-0e9a85484cc8 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-965fce77-5167-46b7-829e-d8975a4b58e8-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-a3f0948e-754c-4e32-84d5-fa29ce5314b7-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-a3f0948e-754c-4e32-84d5-fa29ce5314b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "cinder-quobyte-a3f0948e-754c-4e32-84d5-fa29ce5314b7" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-a3f0948e-754c-4e32-84d5-fa29ce5314b7" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca1008a-d0e8-4e5e-bd9e-8885de2d8933]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:45 devstack sudo[110617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7
Jun 26 00:34:45 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-c9105b2f-39a9-4e9c-abe6-df8881e6872c req-96f0b739-5235-422b-8f93-50c42ea57bcb tempest-TestInstancesWithCinderVolumes-768015916 None] Terminate volume connection completed successfully.
Jun 26 00:34:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-c9105b2f-39a9-4e9c-abe6-df8881e6872c req-96f0b739-5235-422b-8f93-50c42ea57bcb tempest-TestInstancesWithCinderVolumes-768015916 None] Deleting attachment 94a3799b-5b4a-4d39-ac67-e86c6c641991. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:34:46 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7" returned: 0 in 0.942s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:46 devstack sudo[110627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7
Jun 26 00:34:46 devstack sudo[110627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:47 devstack sudo[110627]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a3f0948e-754c-4e32-84d5-fa29ce5314b7" returned: 0 in 0.762s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-quobyte-a3f0948e-754c-4e32-84d5-fa29ce5314b7" released by "delete_volume" :: held 1.825s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Created reservations ['ca3119c5-cbed-4c3f-b581-db015eaaf053', '05060485-8137-44f9-ae36-4fff44043a4f', 'd1784d3b-2ccb-45be-a8a7-10b438d69124', '2429bcf9-a7d9-43a1-ab5e-f4b4520b1fa2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:47 devstack sudo[110631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:47 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "cinder-8068e711-ed03-4c86-b8fc-cc51be91425f-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-8068e711-ed03-4c86-b8fc-cc51be91425f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "cinder-quobyte-8068e711-ed03-4c86-b8fc-cc51be91425f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-quobyte-8068e711-ed03-4c86-b8fc-cc51be91425f" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e323a-e586-4fd5-8b7a-0da34df8e7b6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:48 devstack sudo[110637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f
Jun 26 00:34:48 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:48 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.040s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Deleted volume successfully.
Jun 26 00:34:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5153d5ef-3342-4dd1-8b34-88f6744eff22 tempest-VolumesSnapshotTestJSON-1955336255 None] Lock "cinder-a3f0948e-754c-4e32-84d5-fa29ce5314b7-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:49 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f" returned: 0 in 1.257s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:49 devstack sudo[110643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f
Jun 26 00:34:49 devstack sudo[110643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:50 devstack sudo[110643]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8068e711-ed03-4c86-b8fc-cc51be91425f" returned: 0 in 0.821s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-quobyte-8068e711-ed03-4c86-b8fc-cc51be91425f" released by "delete_volume" :: held 2.143s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:50 devstack cinder-volume[94563]: WARNING cinder.quota [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717661897-1244633241 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717661897-1244633241, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:34:50 devstack cinder-volume[94563]: WARNING cinder.quota [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717661897-1244633241 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717661897-1244633241, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Created reservations ['d7b5850a-f254-447a-be32-f613fae7df21', 'f6d295cd-f2f4-4b29-a523-0e3657fefa93', 'fe87c652-96f4-445f-934a-94ccf0c80dad', '770ac7de-ae39-4673-91b3-0d0cd29d1ad0'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:50 devstack sudo[110647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:50 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:51 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.884s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:51 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Deleted volume successfully.
Jun 26 00:34:51 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-48ab24b0-29c7-411e-9cd7-02ce3c0a18c9 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-8068e711-ed03-4c86-b8fc-cc51be91425f-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:54 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-077995c8-5de0-478b-84a8-5bde19001465 req-5f93b0cf-7928-4d1a-ad15-0388d1293be4 tempest-TestInstancesWithCinderVolumes-768015916 None] Terminate volume connection completed successfully.
Jun 26 00:34:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-077995c8-5de0-478b-84a8-5bde19001465 req-5f93b0cf-7928-4d1a-ad15-0388d1293be4 tempest-TestInstancesWithCinderVolumes-768015916 None] Deleting attachment f4c9b7ad-2ce8-4d33-a073-2261dd1a5de7. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:34:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "cinder-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "cinder-quobyte-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:34:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-quobyte-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:34:56 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770ce38-422a-4737-a490-c30fd75c12a6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:34:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:56 devstack sudo[110684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e
Jun 26 00:34:56 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:57 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" returned: 0 in 1.069s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:57 devstack sudo[110689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e
Jun 26 00:34:57 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:58 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" returned: 0 in 1.049s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-quobyte-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e" released by "delete_volume" :: held 2.212s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=120,cinder:INSERT=32,cinder:UPDATE=121,cinder:DELETE=8 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=107,cinder:INSERT=34,cinder:UPDATE=130,cinder:DELETE=7 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:34:58 devstack cinder-volume[94563]: WARNING cinder.quota [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520395793-429894703 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520395793-429894703, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:34:58 devstack cinder-volume[94563]: WARNING cinder.quota [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520395793-429894703 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520395793-429894703, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Created reservations ['4ac53fdf-25ab-47b2-bb76-7b30a61f2064', 'dbebb96c-ac68-4af4-ba76-cd9d6aa5a57f', '19362f09-8799-48b6-851d-1bc22837274d', '2dbcab4e-3df7-49d3-838f-4c21923a3157'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:58 devstack sudo[110694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:34:58 devstack sudo[110694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Flow 'volume_create_manager' (634f6260-3680-4b37-8ab8-2b7dfc430eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1671f67e-d5f3-45a0-830b-cc52da90cd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1671f67e-d5f3-45a0-830b-cc52da90cd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-388577695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a109cd-2a24-4b1d-ad12-9875cefae0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53709a2969d14260bd0308b40812aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:58Z,use_quota=True,user_id='981f78570d4e4b4396bf6485a88361b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a544dd0f-911a-4a26-8c50-a2912f7aa048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a544dd0f-911a-4a26-8c50-a2912f7aa048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501bef45-2524-4d10-b7e4-f951685958f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501bef45-2524-4d10-b7e4-f951685958f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a109cd-2a24-4b1d-ad12-9875cefae0b0', 'volume_name': 'volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0', 'volume_size': 2}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d7792e-c8c4-4f09-a88d-388a4bf80bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d7792e-c8c4-4f09-a88d-388a4bf80bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f9c0c1-1d57-4384-9f42-0e533e1126f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Volume f4a109cd-2a24-4b1d-ad12-9875cefae0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0', 'volume_size': 2}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-388577695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a109cd-2a24-4b1d-ad12-9875cefae0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53709a2969d14260bd0308b40812aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:58Z,use_quota=True,user_id='981f78570d4e4b4396bf6485a88361b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Creating volume f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:34:58 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 2147483648 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:34:58 devstack sudo[110696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 2147483648
Jun 26 00:34:58 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Flow 'volume_create_manager' (114a9686-b7ae-4159-a50e-e3d11d24f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f30ac9-3a6c-452b-b4e1-0d6e6ff40cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f30ac9-3a6c-452b-b4e1-0d6e6ff40cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1045754232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c687a93f-52d1-4f41-8207-c2c71d575c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce41386941a04c5fb91a10fbcd2bf1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:59Z,use_quota=True,user_id='b11ec06596f646939c73cfff4d1e1517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58b82929-429a-456a-a891-222de5a41e98),volume_type_id=58b82929-429a-456a-a891-222de5a41e98)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffd628-5e15-4d35-9c1a-0095f0932169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffd628-5e15-4d35-9c1a-0095f0932169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12227580-3ea8-4fd5-9dd7-8b8287eecf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12227580-3ea8-4fd5-9dd7-8b8287eecf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c687a93f-52d1-4f41-8207-c2c71d575c20', 'volume_name': 'volume-c687a93f-52d1-4f41-8207-c2c71d575c20', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6fef44-5c6b-4399-bc96-fa06907b16a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6fef44-5c6b-4399-bc96-fa06907b16a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d493a9-1ca9-4c97-b620-0f1a28cd4c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:34:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Volume c687a93f-52d1-4f41-8207-c2c71d575c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c687a93f-52d1-4f41-8207-c2c71d575c20', 'volume_size': 1}
Jun 26 00:34:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:34:59 devstack sudo[110694]: pam_unix(sudo:session): session closed for user root
Jun 26 00:34:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.074s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:34:59 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:34:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Deleted volume successfully.
Jun 26 00:34:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d42561ac-3274-44b7-80a8-5026059350af tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-f0fdf8b0-c2d3-4c22-8251-96fd7cc1c64e-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:00 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 2147483648" returned: 0 in 1.478s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:00 devstack sudo[110705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0
Jun 26 00:35:00 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:35:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:01 devstack sudo[110729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:01 devstack sudo[110729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:01 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" returned: 0 in 0.955s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] <== create_volume: return (2513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.517s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.378s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1045754232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c687a93f-52d1-4f41-8207-c2c71d575c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce41386941a04c5fb91a10fbcd2bf1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:34:59Z,use_quota=True,user_id='b11ec06596f646939c73cfff4d1e1517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58b82929-429a-456a-a891-222de5a41e98),volume_type_id=58b82929-429a-456a-a891-222de5a41e98)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Creating volume c687a93f-52d1-4f41-8207-c2c71d575c20 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:01 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f9c0c1-1d57-4384-9f42-0e533e1126f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0', 'volume_size': 2}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a042e6f2-6cf6-4f32-8d27-02078c59831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:01 devstack sudo[110736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20 1073741824
Jun 26 00:35:01 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Volume volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 (f4a109cd-2a24-4b1d-ad12-9875cefae0b0): created successfully
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a042e6f2-6cf6-4f32-8d27-02078c59831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Flow 'volume_create_manager' (634f6260-3680-4b37-8ab8-2b7dfc430eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-beee3934-ecb8-4d78-8909-86cc9ea2dadd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Created volume successfully.
Jun 26 00:35:02 devstack sudo[110729]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.098s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:02 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20 1073741824" returned: 0 in 1.382s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:02 devstack sudo[110768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20
Jun 26 00:35:02 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Flow 'volume_create_manager' (549dad4e-f6bf-4dc0-80a0-810b411fb5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b4fcb2-61e7-47c9-a48c-82cba31fefa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b4fcb2-61e7-47c9-a48c-82cba31fefa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a416ff67-1f90-4451-9cbd-4b2ca8ce300f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f89a84feb1c4554a170a1a48e8594c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:03Z,use_quota=True,user_id='6ee04ab8314a4229b5e8d40bd4ab94e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(872311d1-c1f4-4cec-8c81-dd902edc9d5b),volume_type_id=872311d1-c1f4-4cec-8c81-dd902edc9d5b)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2940d595-e2d8-4bb3-8478-5f02e6c05e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2940d595-e2d8-4bb3-8478-5f02e6c05e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f74c278-132b-4d7a-8418-2b177ac3de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:35:03 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20" returned: 0 in 0.861s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.319s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Creating offline snapshot d1d7165c-a2d4-465f-94e0-68309bc8966c of volume f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d493a9-1ca9-4c97-b620-0f1a28cd4c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c687a93f-52d1-4f41-8207-c2c71d575c20', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18268310-89d1-4cfe-a43c-33d6aa2ec021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd3d2f4-d5ea-4a85-a0e5-a4b900d39497]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Volume volume-c687a93f-52d1-4f41-8207-c2c71d575c20 (c687a93f-52d1-4f41-8207-c2c71d575c20): created successfully
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18268310-89d1-4cfe-a43c-33d6aa2ec021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Flow 'volume_create_manager' (114a9686-b7ae-4159-a50e-e3d11d24f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1e1c80ec-1c97-4138-84aa-b163bc9aae99 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Created volume successfully.
Jun 26 00:35:03 devstack sudo[110772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0
Jun 26 00:35:03 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f74c278-132b-4d7a-8418-2b177ac3de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a416ff67-1f90-4451-9cbd-4b2ca8ce300f', 'volume_name': 'volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f', 'volume_size': 1, 'image_id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc529836-4923-47af-99e0-c02b9ea4b60d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602a1449a40c8e1c9d6320afc06b304f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f89a84feb1c4554a170a1a48e8594c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8788894a7b493436bdfbfab8d4070c6698920e675b97287b40d90e949d8089349f16561d5c58eb66169030bf24f96cf948582dc8e73778d214d55f0a6d7df542', 'id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'created_at': datetime.datetime(2026, 6, 25, 22, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc529836-4923-47af-99e0-c02b9ea4b60d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459e38e60>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe4c6ea-bb56-4f3b-950c-6fdc46c0ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe4c6ea-bb56-4f3b-950c-6fdc46c0ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6c088a-7e62-4b41-8db3-ab81df82eedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Volume a416ff67-1f90-4451-9cbd-4b2ca8ce300f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f', 'volume_size': 1, 'image_id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc529836-4923-47af-99e0-c02b9ea4b60d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602a1449a40c8e1c9d6320afc06b304f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f89a84feb1c4554a170a1a48e8594c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8788894a7b493436bdfbfab8d4070c6698920e675b97287b40d90e949d8089349f16561d5c58eb66169030bf24f96cf948582dc8e73778d214d55f0a6d7df542', 'id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'created_at': datetime.datetime(2026, 6, 25, 22, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc529836-4923-47af-99e0-c02b9ea4b60d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459e38e60>}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Trying to clone a416ff67-1f90-4451-9cbd-4b2ca8ce300f from image dc529836-4923-47af-99e0-c02b9ea4b60d at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc529836-4923-47af-99e0-c02b9ea4b60d', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:35:03 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[87072293-dabc-406f-bae3-ba7ae691ad5b]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:04 devstack sudo[110774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD
Jun 26 00:35:04 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-0314e268-a9ec-4f65-9165-58a07fe722c6 req-77116089-df7e-4b78-9d87-3f4155dda0cf tempest-TestInstancesWithCinderVolumes-768015916 None] Terminate volume connection completed successfully.
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-0314e268-a9ec-4f65-9165-58a07fe722c6 req-77116089-df7e-4b78-9d87-3f4155dda0cf tempest-TestInstancesWithCinderVolumes-768015916 None] Deleting attachment 10ea0b61-c402-4232-b6c3-48113ff88391. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:35:04 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" returned: 0 in 0.931s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c 2G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:04 devstack sudo[110782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c 2G
Jun 26 00:35:04 devstack sudo[110782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:04 devstack sudo[110784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:04 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:04 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD" returned: 0 in 0.866s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:04 devstack sudo[110788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD
Jun 26 00:35:04 devstack sudo[110788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:05 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.724s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c77e6314-55af-442b-be91-7740de566bf5 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Retype volume completed successfully.
Jun 26 00:35:05 devstack sudo[110782]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c 2G" returned: 0 in 0.940s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:05 devstack sudo[110795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c
Jun 26 00:35:05 devstack sudo[110795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:05 devstack sudo[110788]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD" returned: 1 in 0.877s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Temporary image dc529836-4923-47af-99e0-c02b9ea4b60d is fetched for user 6ee04ab8314a4229b5e8d40bd4ab94e8. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Acquiring lock "cinder-c687a93f-52d1-4f41-8207-c2c71d575c20-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1b8f6b-88db-49ef-9b98-a77500386f0c]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "cinder-c687a93f-52d1-4f41-8207-c2c71d575c20-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Acquiring lock "cinder-quobyte-c687a93f-52d1-4f41-8207-c2c71d575c20" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "cinder-quobyte-c687a93f-52d1-4f41-8207-c2c71d575c20" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[425fd5e6-9d7b-406c-b673-3c385ae2dccf]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:05 devstack sudo[110800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD
Jun 26 00:35:05 devstack sudo[110800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:06 devstack sudo[110801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20
Jun 26 00:35:06 devstack sudo[110801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:06 devstack sudo[110795]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c" returned: 0 in 0.769s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:06 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c is being set with open permissions: ugo+rw
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:06 devstack sudo[110807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c
Jun 26 00:35:06 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:06 devstack sudo[110800]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD" returned: 0 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:06 devstack sudo[110813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD
Jun 26 00:35:06 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:06 devstack sudo[110801]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20" returned: 0 in 0.921s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:06 devstack sudo[110818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20
Jun 26 00:35:06 devstack sudo[110818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:06 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c" returned: 0 in 0.751s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:07 devstack sudo[110820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info
Jun 26 00:35:07 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:07 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD" returned: 1 in 0.852s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:07 devstack sudo[110818]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c687a93f-52d1-4f41-8207-c2c71d575c20" returned: 0 in 0.737s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "cinder-quobyte-c687a93f-52d1-4f41-8207-c2c71d575c20" released by "delete_volume" :: held 1.710s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:07 devstack cinder-volume[94563]: WARNING cinder.quota [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:35:07 devstack cinder-volume[94563]: WARNING cinder.quota [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Created reservations ['b7bfc90a-e4a8-4af0-a507-e1ce3c608257', '915555c1-2df6-4217-86b3-e459bfc8302c', '5f86ebd6-a554-460f-9b0d-2e85b20310be', '362085bc-f967-460a-aa34-164714a37d9c'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "cinder-9b8ef581-dc0d-4b56-998f-66b1ca59f680-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-9b8ef581-dc0d-4b56-998f-66b1ca59f680-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:07 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:07 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info is being set with open permissions: ugo+rw
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:07 devstack sudo[110828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:07 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "cinder-quobyte-9b8ef581-dc0d-4b56-998f-66b1ca59f680" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-quobyte-9b8ef581-dc0d-4b56-998f-66b1ca59f680" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:07 devstack sudo[110830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:07 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d65c66e-3ed1-4451-b158-dadc2cbd8ffd]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:08 devstack sudo[110832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:35:08 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:08 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.info" returned: 0 in 0.773s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.022s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a416ff67-1f90-4451-9cbd-4b2ca8ce300f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f89a84feb1c4554a170a1a48e8594c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:03Z,use_quota=True,user_id='6ee04ab8314a4229b5e8d40bd4ab94e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(872311d1-c1f4-4cec-8c81-dd902edc9d5b),volume_type_id=872311d1-c1f4-4cec-8c81-dd902edc9d5b)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Creating volume a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:08 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:08 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:08 devstack sudo[110836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f 1073741824
Jun 26 00:35:08 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Deleted volume successfully.
Jun 26 00:35:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1fb657f9-b914-4aaf-9c3b-fc1be2658833 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Create snapshot completed successfully
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab5c59af-be8c-4641-b8ed-db2c385fccd2 tempest-VolumeRetypeWithoutMigrationTest-1695768272 None] Lock "cinder-c687a93f-52d1-4f41-8207-c2c71d575c20-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:08 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 0 in 0.955s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:08 devstack sudo[110840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:35:08 devstack sudo[110840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:09 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f 1073741824" returned: 0 in 0.972s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:09 devstack sudo[110848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:09 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:09 devstack sudo[110840]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 1 in 0.875s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:09 devstack sudo[110850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680
Jun 26 00:35:09 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "cinder-d1d7165c-a2d4-465f-94e0-68309bc8966c-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-d1d7165c-a2d4-465f-94e0-68309bc8966c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "cinder-quobyte-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-quobyte-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "cinder-quobyte-d1d7165c-a2d4-465f-94e0-68309bc8966c" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-quobyte-d1d7165c-a2d4-465f-94e0-68309bc8966c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Deleting offline snapshot d1d7165c-a2d4-465f-94e0-68309bc8966c of volume f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] snapshot_file for this snap is: volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[600989be-0724-4a17-b262-277251cb4553]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:10 devstack sudo[110852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c
Jun 26 00:35:10 devstack sudo[110852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:10 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 0 in 0.952s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:10 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9b8ef581-dc0d-4b56-998f-66b1ca59f680" returned: 0 in 0.859s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-quobyte-9b8ef581-dc0d-4b56-998f-66b1ca59f680" released by "delete_volume" :: held 2.768s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Attempting download of dc529836-4923-47af-99e0-c02b9ea4b60d ((None, [{'url': 'file:///opt/stack/data/glance/images/dc529836-4923-47af-99e0-c02b9ea4b60d', 'metadata': {}}])) to volume a416ff67-1f90-4451-9cbd-4b2ca8ce300f. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:35:10 devstack cinder-volume[94563]: WARNING cinder.quota [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765279133-783420020 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765279133-783420020, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:35:10 devstack cinder-volume[94563]: WARNING cinder.quota [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765279133-783420020 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765279133-783420020, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Created reservations ['778ec7a1-b14d-4649-af7d-87141301bc94', 'c879afad-1885-4446-b13f-1b1ac8e29287', 'a1a28084-8703-44f6-8527-cfa3ebacc68d', '2fd4484b-7480-4861-b996-840627ae2eaa'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d834a5c5-95be-4d4a-a61b-05df8d232af7]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:10 devstack sudo[110859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:10 devstack sudo[110859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:10 devstack sudo[110856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby
Jun 26 00:35:10 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:10 devstack sudo[110852]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c" returned: 0 in 1.021s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2076e948-51db-427a-bafd-8a1fa3d9008d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:11 devstack sudo[110864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0
Jun 26 00:35:11 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:11 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby" returned: 0 in 1.057s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:11 devstack sudo[110859]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.045s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Deleted volume successfully.
Jun 26 00:35:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a8e5fe2a-1fe1-40f5-9899-4e4e248026c7 tempest-TestInstancesWithCinderVolumes-768015916 None] Lock "cinder-9b8ef581-dc0d-4b56-998f-66b1ca59f680-delete_volume" released by "delete_volume" :: held 4.168s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:11 devstack sudo[110869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby
Jun 26 00:35:11 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:12 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" returned: 0 in 1.163s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:12 devstack sudo[110875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c
Jun 26 00:35:12 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:12 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby" returned: 1 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc529836-4923-47af-99e0-c02b9ea4b60d_i7gh1qby' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7945adf9-b030-4d17-8dab-b6f68384f36a]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:12 devstack sudo[110879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD
Jun 26 00:35:12 devstack sudo[110879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:13 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c" returned: 0 in 0.942s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:13 devstack sudo[110884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c
Jun 26 00:35:13 devstack sudo[110884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:13 devstack sudo[110879]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD" returned: 0 in 0.933s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:13 devstack sudo[110888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD
Jun 26 00:35:13 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:13 devstack sudo[110884]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0.d1d7165c-a2d4-465f-94e0-68309bc8966c" returned: 0 in 0.816s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-quobyte-d1d7165c-a2d4-465f-94e0-68309bc8966c" released by "_delete_snapshot" :: held 4.141s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-quobyte-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" released by "delete_snapshot" :: held 4.186s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Created reservations ['8122a232-9d81-4edb-addf-67c673616d78', '3c89ed6b-bb61-4040-90c4-1de06768a3da', '84aadffe-f62b-4ac9-93dc-007bcf62f0f3', '2732e5dc-337c-46e4-b2d7-9efc272eba87'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Delete snapshot completed successfully.
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-df67e4ea-187c-429b-9d2f-00a6ab941673 tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-d1d7165c-a2d4-465f-94e0-68309bc8966c-delete_snapshot" released by "delete_snapshot" :: held 4.521s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:14 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD" returned: 1 in 0.973s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] dc529836-4923-47af-99e0-c02b9ea4b60d was raw, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:35:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:14 devstack sudo[110896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:14 devstack sudo[110896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Flow 'volume_create_manager' (fa21c86f-5d40-44d8-a064-03305ebc3bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6b54a4-5371-4b5c-b630-0c279c1d5172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6b54a4-5371-4b5c-b630-0c279c1d5172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-780375076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cb3653-80ba-49a5-b090-29b33463303d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f6de6c2d947b7b7bd95456c56172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:15Z,use_quota=True,user_id='cb6299f225894fb8a1f23d5543e325bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8467a2-2479-4a76-bd54-07247160fa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8467a2-2479-4a76-bd54-07247160fa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc181970-b5e5-479e-980a-2c5f151d4221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc181970-b5e5-479e-980a-2c5f151d4221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40cb3653-80ba-49a5-b090-29b33463303d', 'volume_name': 'volume-40cb3653-80ba-49a5-b090-29b33463303d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a571762-3f33-41d5-aa79-7ee7d645709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a571762-3f33-41d5-aa79-7ee7d645709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443d2c02-b117-48b8-9aed-715d3a723783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:15 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Volume 40cb3653-80ba-49a5-b090-29b33463303d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40cb3653-80ba-49a5-b090-29b33463303d', 'volume_size': 1}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-780375076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cb3653-80ba-49a5-b090-29b33463303d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f6de6c2d947b7b7bd95456c56172f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:15Z,use_quota=True,user_id='cb6299f225894fb8a1f23d5543e325bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Creating volume 40cb3653-80ba-49a5-b090-29b33463303d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:15 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:15 devstack sudo[110901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d 1073741824
Jun 26 00:35:15 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "cinder-f4a109cd-2a24-4b1d-ad12-9875cefae0b0-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-f4a109cd-2a24-4b1d-ad12-9875cefae0b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "cinder-quobyte-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-quobyte-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" acquired by "delete_volume" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[436213e9-47ea-4fe0-887e-91cae0ed2ece]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:15 devstack sudo[110896]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 0 in 0.972s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc529836-4923-47af-99e0-c02b9ea4b60d_bfacccr0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:35:15 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 00:35:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:15 devstack sudo[110904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f 1G
Jun 26 00:35:15 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:15 devstack sudo[110903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0
Jun 26 00:35:15 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:16 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d 1073741824" returned: 0 in 1.144s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:16 devstack sudo[110917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d
Jun 26 00:35:16 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:16 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" returned: 0 in 1.068s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:16 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f 1G" returned: 0 in 0.997s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:16 devstack sudo[110919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0
Jun 26 00:35:16 devstack sudo[110919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0fc01-25b6-42cf-ac86-44626f6a0375]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:16 devstack sudo[110921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:16 devstack sudo[110921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:17 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d" returned: 0 in 0.896s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443d2c02-b117-48b8-9aed-715d3a723783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40cb3653-80ba-49a5-b090-29b33463303d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c38fcc-0f10-4e63-ae68-993c84a15db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:17 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Volume volume-40cb3653-80ba-49a5-b090-29b33463303d (40cb3653-80ba-49a5-b090-29b33463303d): created successfully
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c38fcc-0f10-4e63-ae68-993c84a15db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Flow 'volume_create_manager' (fa21c86f-5d40-44d8-a064-03305ebc3bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:17 devstack sudo[110919]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" returned: 0 in 0.821s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-63b22fff-aafd-4d7c-b59f-fd913317295f tempest-VolumesServicesTestJSON-1235267675 None] Created volume successfully.
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-quobyte-f4a109cd-2a24-4b1d-ad12-9875cefae0b0" released by "delete_volume" :: held 1.976s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Created reservations ['364062a2-0098-4840-91e3-ec8fd8b96a51', '089d53bd-1fed-494c-9920-f09073541796', 'e8a98d79-4f9e-42e8-ae0f-5981788c8081', '814eec9b-0079-47ac-9c45-6305496d00af'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:17 devstack sudo[110921]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 0 in 0.888s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:17 devstack sudo[110929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:17 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:17 devstack sudo[110928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:17 devstack sudo[110928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:18 devstack sudo[110928]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 1 in 1.007s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:18 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Downloaded image dc529836-4923-47af-99e0-c02b9ea4b60d ((None, [{'url': 'file:///opt/stack/data/glance/images/dc529836-4923-47af-99e0-c02b9ea4b60d', 'metadata': {}}])) to volume a416ff67-1f90-4451-9cbd-4b2ca8ce300f successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Temporary image dc529836-4923-47af-99e0-c02b9ea4b60d for user 6ee04ab8314a4229b5e8d40bd4ab94e8 is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Marking volume a416ff67-1f90-4451-9cbd-4b2ca8ce300f as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.930s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Copying metadata from image dc529836-4923-47af-99e0-c02b9ea4b60d to a416ff67-1f90-4451-9cbd-4b2ca8ce300f. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Creating volume glance metadata for volume a416ff67-1f90-4451-9cbd-4b2ca8ce300f backed by image dc529836-4923-47af-99e0-c02b9ea4b60d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '602a1449a40c8e1c9d6320afc06b304f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:35:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Deleted volume successfully.
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-81378335-511f-41bf-9c28-d68fa3b073bd tempest-VolumesSnapshotNegativeTestJSON-320916890 None] Lock "cinder-f4a109cd-2a24-4b1d-ad12-9875cefae0b0-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Acquiring lock "cinder-40cb3653-80ba-49a5-b090-29b33463303d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Lock "cinder-40cb3653-80ba-49a5-b090-29b33463303d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6c088a-7e62-4b41-8db3-ab81df82eedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f', 'volume_size': 1, 'image_id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc529836-4923-47af-99e0-c02b9ea4b60d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602a1449a40c8e1c9d6320afc06b304f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f89a84feb1c4554a170a1a48e8594c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8788894a7b493436bdfbfab8d4070c6698920e675b97287b40d90e949d8089349f16561d5c58eb66169030bf24f96cf948582dc8e73778d214d55f0a6d7df542', 'id': 'dc529836-4923-47af-99e0-c02b9ea4b60d', 'created_at': datetime.datetime(2026, 6, 25, 22, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc529836-4923-47af-99e0-c02b9ea4b60d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459e38e60>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f1b8b6-1461-4a0b-b16a-0fa1287bf62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:18 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Volume volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f (a416ff67-1f90-4451-9cbd-4b2ca8ce300f): created successfully
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f1b8b6-1461-4a0b-b16a-0fa1287bf62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Flow 'volume_create_manager' (549dad4e-f6bf-4dc0-80a0-810b411fb5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:18 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-519b1702-3a2e-4e55-ace8-140dda682aa2 tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Created volume successfully.
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Acquiring lock "cinder-quobyte-40cb3653-80ba-49a5-b090-29b33463303d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Lock "cinder-quobyte-40cb3653-80ba-49a5-b090-29b33463303d" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e4dc5-eadd-41fc-a687-d5effd5d99eb]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:19 devstack sudo[110936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d
Jun 26 00:35:19 devstack sudo[110936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Acquiring lock "cinder-a416ff67-1f90-4451-9cbd-4b2ca8ce300f-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "cinder-a416ff67-1f90-4451-9cbd-4b2ca8ce300f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Acquiring lock "cinder-quobyte-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "cinder-quobyte-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d23f4bc-70af-4d3a-b0f5-64e9c3ae5486]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:20 devstack sudo[110936]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d" returned: 0 in 1.106s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:20 devstack sudo[110943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d
Jun 26 00:35:20 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:20 devstack sudo[110942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:20 devstack sudo[110942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:20 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-40cb3653-80ba-49a5-b090-29b33463303d" returned: 0 in 0.831s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Lock "cinder-quobyte-40cb3653-80ba-49a5-b090-29b33463303d" released by "delete_volume" :: held 1.992s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 0 in 0.997s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:20 devstack sudo[110942]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Created reservations ['fa49faf8-a3ca-467d-8e32-4cf42fe7f89f', '065a4356-bc88-466d-a571-8c7e63298573', '0b41a79f-139a-4e7e-a1ca-8794631a8610', '0c873067-c6a3-40dc-b0bd-162afae8e328'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:21 devstack sudo[110950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:21 devstack sudo[110950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:21 devstack sudo[110949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:21 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (e94b37be-d281-4d30-a92c-2fe867356520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d973ce9-4983-4e34-9a1f-0b7ecf2b2964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d973ce9-4983-4e34-9a1f-0b7ecf2b2964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430865205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76223616-f739-4800-afe0-c5cc8a7f606a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:22Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ce1b9a-8fb8-40d6-aaa2-a82a99bac297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ce1b9a-8fb8-40d6-aaa2-a82a99bac297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444931f0-27cf-47f4-a1aa-7f624307aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444931f0-27cf-47f4-a1aa-7f624307aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76223616-f739-4800-afe0-c5cc8a7f606a', 'volume_name': 'volume-76223616-f739-4800-afe0-c5cc8a7f606a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b860e7df-8205-4dab-9390-ec1650da479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b860e7df-8205-4dab-9390-ec1650da479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b210f6-1747-4241-b3b8-b529549e0fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:21 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume 76223616-f739-4800-afe0-c5cc8a7f606a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76223616-f739-4800-afe0-c5cc8a7f606a', 'volume_size': 1}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430865205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76223616-f739-4800-afe0-c5cc8a7f606a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:22Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating volume 76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:21 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:21 devstack sudo[110955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a 1073741824
Jun 26 00:35:21 devstack sudo[110955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:22 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 1 in 1.040s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:22 devstack sudo[110950]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.859s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:22 devstack sudo[110959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:22 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Deleted volume successfully.
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-52679318-5562-404d-a99e-ea0df0ef3a05 tempest-VolumesServicesTestJSON-1235267675 None] Lock "cinder-40cb3653-80ba-49a5-b090-29b33463303d-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:22 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" returned: 0 in 0.923s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:22 devstack sudo[110955]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "cinder-quobyte-a416ff67-1f90-4451-9cbd-4b2ca8ce300f" released by "delete_volume" :: held 3.068s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a 1073741824" returned: 0 in 1.134s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:23 devstack cinder-volume[94563]: WARNING cinder.quota [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:35:23 devstack cinder-volume[94563]: WARNING cinder.quota [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Created reservations ['badaa98f-bbf2-4b03-84af-0c20e3cfdff0', 'd453799f-24db-4050-87b0-eb350372fbc5', '3273a47b-cd52-481a-9585-07496b1bbcf9', '135422c8-70da-4274-9241-14f2e3c6e5ff'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:23 devstack sudo[110967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a
Jun 26 00:35:23 devstack sudo[110967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:23 devstack sudo[110969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:23 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:24 devstack sudo[110967]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a" returned: 0 in 1.075s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b210f6-1747-4241-b3b8-b529549e0fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76223616-f739-4800-afe0-c5cc8a7f606a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:24 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84290d95-f57c-4279-9d10-1ccf6fa815e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.984s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Deleted volume successfully.
Jun 26 00:35:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume volume-76223616-f739-4800-afe0-c5cc8a7f606a (76223616-f739-4800-afe0-c5cc8a7f606a): created successfully
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84290d95-f57c-4279-9d10-1ccf6fa815e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (e94b37be-d281-4d30-a92c-2fe867356520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-79585ef7-7ee3-409e-937d-b87a0ed91f9a tempest-VolumeAndVolumeTypeFromImageTest-1451697142 None] Lock "cinder-a416ff67-1f90-4451-9cbd-4b2ca8ce300f-delete_volume" released by "delete_volume" :: held 4.413s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c87806ae-07fd-49cd-9981-e6c231a84b4a tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created volume successfully.
Jun 26 00:35:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating offline snapshot 968d943e-82e3-4080-812a-7fc6e4ec1cd4 of volume 76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:35:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4ee1fd-72da-4be6-b240-9a05375ae599]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:25 devstack sudo[110974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a
Jun 26 00:35:25 devstack sudo[110974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:26 devstack sudo[110974]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a" returned: 0 in 1.152s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:26 devstack sudo[110993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 1G
Jun 26 00:35:26 devstack sudo[110993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:27 devstack sudo[110993]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 1G" returned: 0 in 1.359s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76223616-f739-4800-afe0-c5cc8a7f606a -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:27 devstack sudo[111020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76223616-f739-4800-afe0-c5cc8a7f606a -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4
Jun 26 00:35:27 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:28 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76223616-f739-4800-afe0-c5cc8a7f606a -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4" returned: 0 in 1.033s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:28 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 is being set with open permissions: ugo+rw
Jun 26 00:35:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:28 devstack sudo[111026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4
Jun 26 00:35:28 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:29 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4" returned: 0 in 0.828s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:29 devstack sudo[111029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info
Jun 26 00:35:29 devstack sudo[111029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:30 devstack sudo[111029]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info" returned: 0 in 0.842s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:30 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info is being set with open permissions: ugo+rw
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:30 devstack sudo[111032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info
Jun 26 00:35:30 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (4f241b46-b1b7-4db5-9db8-1ed83c6de2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee135d7-2519-46e0-ae3a-59227d45b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee135d7-2519-46e0-ae3a-59227d45b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820538346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:31Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead1cd92-45a3-4bde-9a57-ff13b8ba7f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead1cd92-45a3-4bde-9a57-ff13b8ba7f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16fc1c7-4364-423f-b8e4-6d9c3c3b14d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16fc1c7-4364-423f-b8e4-6d9c3c3b14d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a', 'volume_name': 'volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7e806e-0edd-46a8-8d24-c1b72ae9ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7e806e-0edd-46a8-8d24-c1b72ae9ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ca0633-112e-45db-a4a0-5131859422c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:30 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume 8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a', 'volume_size': 1}
Jun 26 00:35:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:31 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.info" returned: 0 in 0.830s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.168s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820538346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:31Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Creating volume 8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:31 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:31 devstack sudo[111036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a 1073741824
Jun 26 00:35:31 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:31 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-369a6178-9fba-40a4-a6f0-00e032c9f30b tempest-CreateVolumesFromSnapshotTest-1036719835 None] Create snapshot completed successfully
Jun 26 00:35:32 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a 1073741824" returned: 0 in 1.063s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:32 devstack sudo[111042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a
Jun 26 00:35:32 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (6751c07a-af18-451f-8a3d-691e41f80b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be90a1d-669a-4ba7-a0cc-b2e62b4367a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be90a1d-669a-4ba7-a0cc-b2e62b4367a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-331157354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1af7e4-99a8-4b5a-bc4e-3156780e0613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:33Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3f67d7-e196-40b7-b9b9-8d960452f73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3f67d7-e196-40b7-b9b9-8d960452f73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:33 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3562a760-8e90-4966-82e7-a49106519a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3562a760-8e90-4966-82e7-a49106519a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1af7e4-99a8-4b5a-bc4e-3156780e0613', 'volume_name': 'volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c61a9a0-3d24-43b6-83f4-948e696f04d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c61a9a0-3d24-43b6-83f4-948e696f04d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97901ef6-ca00-4144-9250-dbdacbfc9bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:33 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume 5a1af7e4-99a8-4b5a-bc4e-3156780e0613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613', 'volume_size': 1}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a" returned: 0 in 0.994s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-331157354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1af7e4-99a8-4b5a-bc4e-3156780e0613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:33Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating volume 5a1af7e4-99a8-4b5a-bc4e-3156780e0613 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:33 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ca0633-112e-45db-a4a0-5131859422c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:33 devstack sudo[111045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 1073741824
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3b5a91-40fa-4d02-9322-d1a92f6f8a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:33 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:33 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a (8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a): created successfully
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3b5a91-40fa-4d02-9322-d1a92f6f8a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (4f241b46-b1b7-4db5-9db8-1ed83c6de2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:33 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-857ca7c6-5d61-4f74-8a5e-4fb0790cf352 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created volume successfully.
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (fc8e5084-33ab-4560-8eeb-d7990012018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1ad8e6-3ad3-497f-8bcf-25446df4ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1ad8e6-3ad3-497f-8bcf-25446df4ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376720884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dd39f5-e607-40e0-8316-430fb20f5eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:34Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5209b1-003c-43f3-b187-0493123ba811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5209b1-003c-43f3-b187-0493123ba811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7c9509-3ac9-4201-9370-1dd52bab9e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7c9509-3ac9-4201-9370-1dd52bab9e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04dd39f5-e607-40e0-8316-430fb20f5eb2', 'volume_name': 'volume-04dd39f5-e607-40e0-8316-430fb20f5eb2', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5754441f-f2bb-4718-89af-55ed699a54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5754441f-f2bb-4718-89af-55ed699a54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f19f6ce-3cf4-4436-a04a-be857085454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume 04dd39f5-e607-40e0-8316-430fb20f5eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04dd39f5-e607-40e0-8316-430fb20f5eb2', 'volume_size': 1}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:34 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (9a99d8ed-c1b2-47ce-9027-22c9c85671a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f83ad93-c31d-4d87-90c4-40f84b0915b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f83ad93-c31d-4d87-90c4-40f84b0915b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506224263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafac7d7-fa5d-4175-8c24-91f83e07d3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:35Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1548157-06ed-411b-9b7e-ed6a52712c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1548157-06ed-411b-9b7e-ed6a52712c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b69b85-38b2-4966-9a70-791a6b969a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b69b85-38b2-4966-9a70-791a6b969a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafac7d7-fa5d-4175-8c24-91f83e07d3b4', 'volume_name': 'volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e004f7-b1db-41af-8191-fbae035880e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e004f7-b1db-41af-8191-fbae035880e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee2b16e-a5da-4687-82ee-886957e7896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume aafac7d7-fa5d-4175-8c24-91f83e07d3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4', 'volume_size': 1}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (8300edcd-b038-4efc-b4f6-63026477145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6502f32f-ce2e-4d55-a751-522b3018a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6502f32f-ce2e-4d55-a751-522b3018a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1338412561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9081db-9220-4198-8be0-153da0fdf3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:35Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9459cef1-3a94-4c02-a988-3ff3c637b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9459cef1-3a94-4c02-a988-3ff3c637b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8996a6-aff4-43bd-9379-61dac968990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8996a6-aff4-43bd-9379-61dac968990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9081db-9220-4198-8be0-153da0fdf3fa', 'volume_name': 'volume-6b9081db-9220-4198-8be0-153da0fdf3fa', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b366c27-7bc4-470e-8c24-708f1e05a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b366c27-7bc4-470e-8c24-708f1e05a040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c9f7f8-4457-43a1-b6f6-2841a76a2f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:35 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume 6b9081db-9220-4198-8be0-153da0fdf3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9081db-9220-4198-8be0-153da0fdf3fa', 'volume_size': 1}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:35 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 1073741824" returned: 0 in 1.824s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:35 devstack sudo[111051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613
Jun 26 00:35:35 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (1af9ba65-4613-45be-a46d-4f89c1170591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9dd365-de50-43a8-9235-df3616c825b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9dd365-de50-43a8-9235-df3616c825b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041143954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c804bc23-c3ae-45ce-892b-428051c1a630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:36Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dae663-bbf6-4ee5-87ac-6d846fa3a27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dae663-bbf6-4ee5-87ac-6d846fa3a27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1fd6d3-7a23-4ab7-9657-c859eb0ba31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1fd6d3-7a23-4ab7-9657-c859eb0ba31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c804bc23-c3ae-45ce-892b-428051c1a630', 'volume_name': 'volume-c804bc23-c3ae-45ce-892b-428051c1a630', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02a6e0b-b8fa-420e-881a-364572ce11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02a6e0b-b8fa-420e-881a-364572ce11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36b4970-472f-4fb8-a1c2-9aa15eac2465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume c804bc23-c3ae-45ce-892b-428051c1a630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c804bc23-c3ae-45ce-892b-428051c1a630', 'volume_size': 1}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (a8c3809c-24cb-403e-b111-379ab6f2cb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c447617b-a882-4b61-b8d4-1b87a5b8be21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c447617b-a882-4b61-b8d4-1b87a5b8be21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146305491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee35db2-ca6b-4cf2-bf8e-11883aadc725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:36Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08acebed-d748-4807-ba50-b00fe88f5ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08acebed-d748-4807-ba50-b00fe88f5ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dc7346-19ff-4876-b4d6-35570190c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dc7346-19ff-4876-b4d6-35570190c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee35db2-ca6b-4cf2-bf8e-11883aadc725', 'volume_name': 'volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d468081-eb34-43eb-9ed5-a1696ef11fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d468081-eb34-43eb-9ed5-a1696ef11fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c197ec31-2242-4e3e-b3a1-a8f4a46c92d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume 0ee35db2-ca6b-4cf2-bf8e-11883aadc725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725', 'volume_size': 1}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:36 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613" returned: 0 in 1.116s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] <== create_volume: return (3014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.017s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.316s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376720884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dd39f5-e607-40e0-8316-430fb20f5eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:34Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating volume 04dd39f5-e607-40e0-8316-430fb20f5eb2 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:36 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:36 devstack sudo[111055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 1073741824
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97901ef6-ca00-4144-9250-dbdacbfc9bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88338ec0-aa6b-4668-8715-c96f8d359f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:36 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 (5a1af7e4-99a8-4b5a-bc4e-3156780e0613): created successfully
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88338ec0-aa6b-4668-8715-c96f8d359f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (6751c07a-af18-451f-8a3d-691e41f80b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6f9a3853-7299-4a68-8b3b-2a8a79acda06 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created volume successfully.
Jun 26 00:35:37 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 1073741824" returned: 0 in 1.336s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:38 devstack sudo[111070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2
Jun 26 00:35:38 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (e341da6e-8fee-471e-a187-db487b192b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13b185a-7e10-4087-90ca-c6796cba3b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13b185a-7e10-4087-90ca-c6796cba3b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339653743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a63366-2c37-41c2-9f65-cf48dc33eeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:38Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4256e6ba-db2b-43bd-8bfc-e4dd1a4468f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4256e6ba-db2b-43bd-8bfc-e4dd1a4468f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed955e2-a348-4e75-8396-05ff7c0d7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed955e2-a348-4e75-8396-05ff7c0d7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a63366-2c37-41c2-9f65-cf48dc33eeaf', 'volume_name': 'volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d5f7cc-78df-4b19-bfcf-547ca22cecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d5f7cc-78df-4b19-bfcf-547ca22cecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ecd285-83b6-41fd-a25f-156813a75f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume c0a63366-2c37-41c2-9f65-cf48dc33eeaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf', 'volume_size': 1}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (81e8d9d9-502e-42be-b508-991723ef63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a1c55-e32d-478a-88cb-389086962207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a1c55-e32d-478a-88cb-389086962207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6563554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761b925a-df98-4cbf-8b69-522adec1e2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:38Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2dd704-1127-44ee-b330-4218440acca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2dd704-1127-44ee-b330-4218440acca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f208f78-4b61-4420-8883-f94c0a70e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f208f78-4b61-4420-8883-f94c0a70e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761b925a-df98-4cbf-8b69-522adec1e2f5', 'volume_name': 'volume-761b925a-df98-4cbf-8b69-522adec1e2f5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12120510-8d78-4515-a2df-f3866af18909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12120510-8d78-4515-a2df-f3866af18909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3590087b-9caa-46f8-a9c2-b816e3ff8882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume 761b925a-df98-4cbf-8b69-522adec1e2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761b925a-df98-4cbf-8b69-522adec1e2f5', 'volume_size': 1}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (722d4dcc-c5d4-487e-af1f-23178b26301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d8e328-33de-4c0a-b7a7-258a7e8cc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (4faeacb2-01ed-4e15-bd1d-628fb5ebc593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373da11a-ad91-4e2b-bee7-c318565568dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d8e328-33de-4c0a-b7a7-258a7e8cc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146903604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac67556-909a-4db1-aca0-8743802cbeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:39Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893f5b9f-1c01-4f79-aade-95c0443b68b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893f5b9f-1c01-4f79-aade-95c0443b68b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876ad44d-7524-4cf3-ac96-d104d5d53acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876ad44d-7524-4cf3-ac96-d104d5d53acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac67556-909a-4db1-aca0-8743802cbeed', 'volume_name': 'volume-cac67556-909a-4db1-aca0-8743802cbeed', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f539d-dafe-4d8d-865c-1189c6cee7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f539d-dafe-4d8d-865c-1189c6cee7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb0b1d5-1826-4ce7-bec7-e8b9571f5ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume cac67556-909a-4db1-aca0-8743802cbeed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac67556-909a-4db1-aca0-8743802cbeed', 'volume_size': 1}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373da11a-ad91-4e2b-bee7-c318565568dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256785738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a143f9cc-bfa7-4ab8-9391-bcab47543256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:39Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708f6a5c-8fd1-4d14-9f65-1bdf58b65688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708f6a5c-8fd1-4d14-9f65-1bdf58b65688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03561a74-b42c-4c61-859d-05cdf312c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03561a74-b42c-4c61-859d-05cdf312c294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a143f9cc-bfa7-4ab8-9391-bcab47543256', 'volume_name': 'volume-a143f9cc-bfa7-4ab8-9391-bcab47543256', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f11628f-d767-4c63-aaf1-fb52c18d2f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f11628f-d767-4c63-aaf1-fb52c18d2f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93a725b-368a-4145-af1d-0083214f92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume a143f9cc-bfa7-4ab8-9391-bcab47543256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a143f9cc-bfa7-4ab8-9391-bcab47543256', 'volume_size': 1}
Jun 26 00:35:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:39 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2" returned: 0 in 1.015s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506224263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafac7d7-fa5d-4175-8c24-91f83e07d3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:35Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Creating volume aafac7d7-fa5d-4175-8c24-91f83e07d3b4 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:39 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f19f6ce-3cf4-4436-a04a-be857085454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04dd39f5-e607-40e0-8316-430fb20f5eb2', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:39 devstack sudo[111073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 1073741824
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b3e983-3c85-450a-999b-79b5e44a5136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:39 devstack sudo[111073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:39 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 (04dd39f5-e607-40e0-8316-430fb20f5eb2): created successfully
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b3e983-3c85-450a-999b-79b5e44a5136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (fc8e5084-33ab-4560-8eeb-d7990012018e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-03ce7b85-c112-40c6-a8f0-49bca2ada364 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created volume successfully.
Jun 26 00:35:40 devstack sudo[111073]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 1073741824" returned: 0 in 1.062s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:40 devstack sudo[111079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4
Jun 26 00:35:40 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:40 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4" returned: 0 in 0.781s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.564s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1338412561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9081db-9220-4198-8be0-153da0fdf3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:35Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating volume 6b9081db-9220-4198-8be0-153da0fdf3fa {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:41 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee2b16e-a5da-4687-82ee-886957e7896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:41 devstack sudo[111082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa 1073741824
Jun 26 00:35:41 devstack sudo[111082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a34c4e-d0b4-49eb-af1f-1d965a0f50cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:41 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 (aafac7d7-fa5d-4175-8c24-91f83e07d3b4): created successfully
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a34c4e-d0b4-49eb-af1f-1d965a0f50cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (9a99d8ed-c1b2-47ce-9027-22c9c85671a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-28378dde-7ce7-4ee1-ade7-59f03aec9ceb tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created volume successfully.
Jun 26 00:35:42 devstack sudo[111082]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa 1073741824" returned: 0 in 1.073s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:42 devstack sudo[111088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa
Jun 26 00:35:42 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:42 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa" returned: 0 in 0.741s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.620s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041143954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c804bc23-c3ae-45ce-892b-428051c1a630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:36Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Creating volume c804bc23-c3ae-45ce-892b-428051c1a630 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:42 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c9f7f8-4457-43a1-b6f6-2841a76a2f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9081db-9220-4198-8be0-153da0fdf3fa', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:42 devstack sudo[111091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630 1073741824
Jun 26 00:35:42 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6694d6a5-1b30-4eaa-a26e-748bce47d1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:42 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume volume-6b9081db-9220-4198-8be0-153da0fdf3fa (6b9081db-9220-4198-8be0-153da0fdf3fa): created successfully
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6694d6a5-1b30-4eaa-a26e-748bce47d1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (8300edcd-b038-4efc-b4f6-63026477145f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e8f82762-6831-46c0-a030-abeff35c75af tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created volume successfully.
Jun 26 00:35:44 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630 1073741824" returned: 0 in 1.255s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:44 devstack sudo[111098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630
Jun 26 00:35:44 devstack sudo[111098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:44 devstack sudo[111098]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630" returned: 0 in 0.704s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.348s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146305491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee35db2-ca6b-4cf2-bf8e-11883aadc725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:36Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating volume 0ee35db2-ca6b-4cf2-bf8e-11883aadc725 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:44 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36b4970-472f-4fb8-a1c2-9aa15eac2465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c804bc23-c3ae-45ce-892b-428051c1a630', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:44 devstack sudo[111101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 1073741824
Jun 26 00:35:44 devstack sudo[111101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e78366-5f36-4c12-817b-33673a7fe3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:44 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume volume-c804bc23-c3ae-45ce-892b-428051c1a630 (c804bc23-c3ae-45ce-892b-428051c1a630): created successfully
Jun 26 00:35:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e78366-5f36-4c12-817b-33673a7fe3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (1af9ba65-4613-45be-a46d-4f89c1170591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:45 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d403e302-64fc-4726-bb2d-38b86709d2b1 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created volume successfully.
Jun 26 00:35:46 devstack sudo[111101]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 1073741824" returned: 0 in 1.104s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:46 devstack sudo[111107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725
Jun 26 00:35:46 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:46 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725" returned: 0 in 0.868s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.613s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339653743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a63366-2c37-41c2-9f65-cf48dc33eeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:38Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Creating volume c0a63366-2c37-41c2-9f65-cf48dc33eeaf {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:46 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:47 devstack sudo[111110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf 1073741824
Jun 26 00:35:47 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c197ec31-2242-4e3e-b3a1-a8f4a46c92d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3bf5fb-fb81-4a86-91f8-c29353d5c1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:47 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 (0ee35db2-ca6b-4cf2-bf8e-11883aadc725): created successfully
Jun 26 00:35:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3bf5fb-fb81-4a86-91f8-c29353d5c1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:47 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (a8c3809c-24cb-403e-b111-379ab6f2cb33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:47 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-92522fca-3541-498b-810b-779949116557 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created volume successfully.
Jun 26 00:35:47 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf 1073741824" returned: 0 in 1.035s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:48 devstack sudo[111116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf
Jun 26 00:35:48 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:48 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf" returned: 0 in 0.956s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.410s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6563554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761b925a-df98-4cbf-8b69-522adec1e2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d533a4b9bd144aa5b82c7ea5231014eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:38Z,use_quota=True,user_id='bf8d3a6b480e472dab78e24aae220335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Creating volume 761b925a-df98-4cbf-8b69-522adec1e2f5 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:49 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:49 devstack sudo[111119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5 1073741824
Jun 26 00:35:49 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ecd285-83b6-41fd-a25f-156813a75f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6f9f82-affc-4516-8caa-989675fb4ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:49 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf (c0a63366-2c37-41c2-9f65-cf48dc33eeaf): created successfully
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6f9f82-affc-4516-8caa-989675fb4ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:49 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (e341da6e-8fee-471e-a187-db487b192b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1470ba07-32cb-404e-ac7f-1e9473928c44 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created volume successfully.
Jun 26 00:35:50 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5 1073741824" returned: 0 in 1.062s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:50 devstack sudo[111125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5
Jun 26 00:35:50 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:50 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5" returned: 0 in 0.792s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.096s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146903604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac67556-909a-4db1-aca0-8743802cbeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:39Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Creating volume cac67556-909a-4db1-aca0-8743802cbeed {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:50 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:51 devstack sudo[111128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed 1073741824
Jun 26 00:35:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3590087b-9caa-46f8-a9c2-b816e3ff8882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761b925a-df98-4cbf-8b69-522adec1e2f5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:51 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c6eaab-9d84-416f-97f8-16b39a40ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:51 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Volume volume-761b925a-df98-4cbf-8b69-522adec1e2f5 (761b925a-df98-4cbf-8b69-522adec1e2f5): created successfully
Jun 26 00:35:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c6eaab-9d84-416f-97f8-16b39a40ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Flow 'volume_create_manager' (81e8d9d9-502e-42be-b508-991723ef63b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e22283ff-a288-4eec-b4ae-10ddfbee4b9e tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created volume successfully.
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-761b925a-df98-4cbf-8b69-522adec1e2f5-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-761b925a-df98-4cbf-8b69-522adec1e2f5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:52 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed 1073741824" returned: 0 in 1.255s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-761b925a-df98-4cbf-8b69-522adec1e2f5" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-761b925a-df98-4cbf-8b69-522adec1e2f5" acquired by "delete_volume" :: waited 0.036s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:52 devstack sudo[111134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed
Jun 26 00:35:52 devstack sudo[111134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[930e2ba4-cb80-4c29-b67c-259c709aa782]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:52 devstack sudo[111136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5
Jun 26 00:35:52 devstack sudo[111136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:53 devstack sudo[111134]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed" returned: 0 in 1.067s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.459s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256785738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a143f9cc-bfa7-4ab8-9391-bcab47543256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d55fc748b480cb564f14368352f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:35:39Z,use_quota=True,user_id='8fec0c82e5024ff7810d9f3111637977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Creating volume a143f9cc-bfa7-4ab8-9391-bcab47543256 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:35:53 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb0b1d5-1826-4ce7-bec7-e8b9571f5ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac67556-909a-4db1-aca0-8743802cbeed', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:53 devstack sudo[111143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 1073741824
Jun 26 00:35:53 devstack sudo[111143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da616bb4-9963-44f5-aecb-aa57a83876e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:53 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume volume-cac67556-909a-4db1-aca0-8743802cbeed (cac67556-909a-4db1-aca0-8743802cbeed): created successfully
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da616bb4-9963-44f5-aecb-aa57a83876e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (722d4dcc-c5d4-487e-af1f-23178b26301a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-09b6289d-ec2b-4233-83ff-c4824763f57f tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created volume successfully.
Jun 26 00:35:53 devstack sudo[111136]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5" returned: 0 in 1.165s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:53 devstack sudo[111145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5
Jun 26 00:35:53 devstack sudo[111145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:54 devstack sudo[111145]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-761b925a-df98-4cbf-8b69-522adec1e2f5" returned: 0 in 0.978s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:54 devstack sudo[111143]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-761b925a-df98-4cbf-8b69-522adec1e2f5" released by "delete_volume" :: held 2.215s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 1073741824" returned: 0 in 1.154s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:54 devstack sudo[111153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256
Jun 26 00:35:54 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['c985271d-0ca0-4404-95e7-6d39a82f185d', 'f9dfcbe0-8f08-45ef-885d-a1629f400852', 'a73cf155-206f-4f5e-8ccc-46522f365be1', '61340157-85f4-470e-ab9c-900d0df69ee1'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:54 devstack sudo[111157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:54 devstack sudo[111157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:55 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256" returned: 0 in 0.999s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93a725b-368a-4145-af1d-0083214f92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a143f9cc-bfa7-4ab8-9391-bcab47543256', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fb8c6b-5eb6-431d-b140-e5d6a0811a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-0ee35db2-ca6b-4cf2-bf8e-11883aadc725-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:55 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Volume volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 (a143f9cc-bfa7-4ab8-9391-bcab47543256): created successfully
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fb8c6b-5eb6-431d-b140-e5d6a0811a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Flow 'volume_create_manager' (4faeacb2-01ed-4e15-bd1d-628fb5ebc593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-0ee35db2-ca6b-4cf2-bf8e-11883aadc725-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-efb21a7a-5ec4-4e71-b2fa-2708268142a8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created volume successfully.
Jun 26 00:35:55 devstack sudo[111157]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.983s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleted volume successfully.
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-0ee35db2-ca6b-4cf2-bf8e-11883aadc725" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d1558cd7-8a90-4462-a47a-5c843f1787bd tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-761b925a-df98-4cbf-8b69-522adec1e2f5-delete_volume" released by "delete_volume" :: held 3.631s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-0ee35db2-ca6b-4cf2-bf8e-11883aadc725" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f636d20-d210-4318-8664-56c245dc0030]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:56 devstack sudo[111163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725
Jun 26 00:35:56 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-a143f9cc-bfa7-4ab8-9391-bcab47543256-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-a143f9cc-bfa7-4ab8-9391-bcab47543256-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-quobyte-a143f9cc-bfa7-4ab8-9391-bcab47543256" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-a143f9cc-bfa7-4ab8-9391-bcab47543256" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfde2700-6117-4993-80ad-3bb19968a0d9]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:56 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725" returned: 0 in 1.038s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:56 devstack sudo[111168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256
Jun 26 00:35:56 devstack sudo[111168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:56 devstack sudo[111169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725
Jun 26 00:35:56 devstack sudo[111169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:57 devstack sudo[111169]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0ee35db2-ca6b-4cf2-bf8e-11883aadc725" returned: 0 in 0.851s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-0ee35db2-ca6b-4cf2-bf8e-11883aadc725" released by "delete_volume" :: held 1.943s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:57 devstack sudo[111168]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256" returned: 0 in 1.075s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['efc071cb-c7f6-4963-a44b-b79bf40542df', 'd3a4db6c-f1ae-4734-80b1-484367932e55', 'a084d975-c55d-4b86-b54e-213973acef20', '31de1ee9-b6b2-472a-9797-eee42a2894cc'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:57 devstack sudo[111176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256
Jun 26 00:35:57 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:58 devstack sudo[111178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:58 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:58 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-a143f9cc-bfa7-4ab8-9391-bcab47543256" returned: 0 in 0.814s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-a143f9cc-bfa7-4ab8-9391-bcab47543256" released by "delete_volume" :: held 1.966s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=99,cinder:INSERT=34,cinder:UPDATE=120,cinder:DELETE=12 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=99,cinder:INSERT=30,cinder:UPDATE=134,cinder:DELETE=13 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:35:58 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.775s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:35:58 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleted volume successfully.
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created reservations ['bef77e4d-f877-4bf7-8221-c7f405cd9e26', '167101c7-780d-48de-a6bd-a5d45811792b', 'e1bbd554-d1a0-4714-9cf2-5867ccce817f', 'a8f8fcbf-bd43-4026-aa93-219f2a355786'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7b3fd429-e03d-450d-9515-61b6959a8e4d tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-0ee35db2-ca6b-4cf2-bf8e-11883aadc725-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:35:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:59 devstack sudo[111182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:35:59 devstack sudo[111182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:35:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-6b9081db-9220-4198-8be0-153da0fdf3fa-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-6b9081db-9220-4198-8be0-153da0fdf3fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-6b9081db-9220-4198-8be0-153da0fdf3fa" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:35:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-6b9081db-9220-4198-8be0-153da0fdf3fa" acquired by "delete_volume" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:35:59 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b6d98f-9ee0-4f86-839e-62fbe662be55]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:35:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:35:59 devstack sudo[111184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa
Jun 26 00:35:59 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:00 devstack sudo[111182]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.071s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Deleted volume successfully.
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-cac67556-909a-4db1-aca0-8743802cbeed-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-cac67556-909a-4db1-aca0-8743802cbeed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de4c746f-053a-42d4-857e-9ff4863291f0 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-a143f9cc-bfa7-4ab8-9391-bcab47543256-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-quobyte-cac67556-909a-4db1-aca0-8743802cbeed" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-cac67556-909a-4db1-aca0-8743802cbeed" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2e799-6ab3-4707-a803-f3f67cd42731]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:00 devstack sudo[111189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed
Jun 26 00:36:00 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:00 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa" returned: 0 in 1.116s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:00 devstack sudo[111192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa
Jun 26 00:36:00 devstack sudo[111192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:01 devstack sudo[111197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:01 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:01 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed" returned: 0 in 1.124s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:01 devstack sudo[111203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed
Jun 26 00:36:01 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:01 devstack sudo[111192]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6b9081db-9220-4198-8be0-153da0fdf3fa" returned: 0 in 1.036s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-6b9081db-9220-4198-8be0-153da0fdf3fa" released by "delete_volume" :: held 2.223s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['8b5f5cd3-f478-45d7-9cb7-8c479229e40a', '52082832-3734-4e81-91a2-7ab818aa5df4', 'b723425b-7f21-4f54-8eab-5b092fc8af54', 'b94aa388-6c35-410b-8365-749681ae3db8'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:01 devstack sudo[111205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:01 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:02 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.183s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:36:02 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-cac67556-909a-4db1-aca0-8743802cbeed" returned: 0 in 0.996s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-cac67556-909a-4db1-aca0-8743802cbeed" released by "delete_volume" :: held 2.177s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created reservations ['8edce148-6288-4397-9b53-904bfb838f15', 'df0530a1-fc62-45dc-8a7b-71d9fb26c429', 'd4c637e7-5203-439d-9cd6-545d8bef7901', '76f9fdb4-8b5e-4751-b6a4-cad1f441890a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:02 devstack sudo[111216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:02 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-04dd39f5-e607-40e0-8316-430fb20f5eb2-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:02 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-04dd39f5-e607-40e0-8316-430fb20f5eb2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.034s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleted volume successfully.
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23234784-45bf-448f-b38a-8054c4993ed4 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-6b9081db-9220-4198-8be0-153da0fdf3fa-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-04dd39f5-e607-40e0-8316-430fb20f5eb2" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-04dd39f5-e607-40e0-8316-430fb20f5eb2" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6196f-5e55-4d2f-9a2c-eba8e683e36c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:02 devstack sudo[111218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2
Jun 26 00:36:02 devstack sudo[111218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:03 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.848s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Deleted volume successfully.
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a5ebf4b8-84a8-4156-bb94-adf608ddb9d8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-cac67556-909a-4db1-aca0-8743802cbeed-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-c0a63366-2c37-41c2-9f65-cf48dc33eeaf-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-c0a63366-2c37-41c2-9f65-cf48dc33eeaf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-quobyte-c0a63366-2c37-41c2-9f65-cf48dc33eeaf" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-c0a63366-2c37-41c2-9f65-cf48dc33eeaf" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[7194b38d-b52d-48de-a2fe-81e7f39ee4b9]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:03 devstack sudo[111223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf
Jun 26 00:36:03 devstack sudo[111223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:03 devstack sudo[111218]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2" returned: 0 in 1.099s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:03 devstack sudo[111226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2
Jun 26 00:36:03 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:04 devstack sudo[111223]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:04 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf" returned: 0 in 1.049s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-04dd39f5-e607-40e0-8316-430fb20f5eb2" returned: 0 in 0.812s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-04dd39f5-e607-40e0-8316-430fb20f5eb2" released by "delete_volume" :: held 1.960s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:04 devstack sudo[111234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf
Jun 26 00:36:04 devstack sudo[111234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:04 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['2c0a7d6c-2172-4a35-80b6-678c7f56bf7e', '9b37bd9b-ff3c-4b1e-a730-e9890ce9dc61', '24697793-73e7-4c4d-989c-ffcc14f92431', 'e42aeb10-55be-44cc-8d62-91ef2b235d12'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:05 devstack sudo[111236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:05 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:05 devstack sudo[111234]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c0a63366-2c37-41c2-9f65-cf48dc33eeaf" returned: 0 in 0.770s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-c0a63366-2c37-41c2-9f65-cf48dc33eeaf" released by "delete_volume" :: held 1.873s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created reservations ['7f8a2d9d-11da-428d-8748-c4c5b82f72c4', '0744ffc4-16b6-4bd4-898f-e3866e1481ed', '589767e3-17c9-4bfa-b3eb-6d5109f61760', '2a60123c-74ba-48c1-9d25-9be12827d5b6'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:05 devstack sudo[111240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:05 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:05 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.755s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleted volume successfully.
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06905686-1cbc-43d1-85a6-935f47966d52 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-04dd39f5-e607-40e0-8316-430fb20f5eb2-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-c804bc23-c3ae-45ce-892b-428051c1a630-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-c804bc23-c3ae-45ce-892b-428051c1a630-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-quobyte-c804bc23-c3ae-45ce-892b-428051c1a630" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-c804bc23-c3ae-45ce-892b-428051c1a630" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-5a1af7e4-99a8-4b5a-bc4e-3156780e0613-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc69de-2e33-41d5-af21-f086d4ef547a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-5a1af7e4-99a8-4b5a-bc4e-3156780e0613-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-5a1af7e4-99a8-4b5a-bc4e-3156780e0613" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-5a1af7e4-99a8-4b5a-bc4e-3156780e0613" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:06 devstack sudo[111242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630
Jun 26 00:36:06 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ff5f5-4a54-42f1-a9a3-e52460514cc9]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:06 devstack sudo[111244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613
Jun 26 00:36:06 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:06 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.021s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:06 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Deleted volume successfully.
Jun 26 00:36:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-969e7753-560a-4f20-9a49-a6020ebcf5f8 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-c0a63366-2c37-41c2-9f65-cf48dc33eeaf-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:07 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613" returned: 0 in 0.984s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:07 devstack sudo[111254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613
Jun 26 00:36:07 devstack sudo[111254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:07 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630" returned: 0 in 1.311s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:07 devstack sudo[111256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630
Jun 26 00:36:07 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:08 devstack sudo[111254]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5a1af7e4-99a8-4b5a-bc4e-3156780e0613" returned: 0 in 1.063s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-5a1af7e4-99a8-4b5a-bc4e-3156780e0613" released by "delete_volume" :: held 2.139s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:08 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c804bc23-c3ae-45ce-892b-428051c1a630" returned: 0 in 1.083s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-c804bc23-c3ae-45ce-892b-428051c1a630" released by "delete_volume" :: held 2.487s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['8b559734-1bd7-4216-8ecc-6e36749c5083', '844e7eb7-e296-43d1-a7a6-2e28df9b9b7a', '28b189fc-4604-49c6-ba57-9bf0cf4565ad', '5816ee90-fa12-41df-8778-e3937cca28cb'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created reservations ['a306a5cf-307d-45ce-bbbd-aa18fb301743', '8e5fc381-ee8b-432e-a0a1-a688c701a99a', '3ab47f36-2dd6-41cc-9c9e-6a1c1c3f48c7', 'ef0f1b0c-7cce-476e-a00c-b936ce8d29ce'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:08 devstack sudo[111260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:08 devstack sudo[111260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:08 devstack sudo[111262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:08 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-aafac7d7-fa5d-4175-8c24-91f83e07d3b4-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-aafac7d7-fa5d-4175-8c24-91f83e07d3b4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-quobyte-aafac7d7-fa5d-4175-8c24-91f83e07d3b4" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-aafac7d7-fa5d-4175-8c24-91f83e07d3b4" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9610282-b4f9-4806-9d73-5f3e6b561493]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-968d943e-82e3-4080-812a-7fc6e4ec1cd4-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-968d943e-82e3-4080-812a-7fc6e4ec1cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-76223616-f739-4800-afe0-c5cc8a7f606a" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-76223616-f739-4800-afe0-c5cc8a7f606a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-968d943e-82e3-4080-812a-7fc6e4ec1cd4" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-968d943e-82e3-4080-812a-7fc6e4ec1cd4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleting offline snapshot 968d943e-82e3-4080-812a-7fc6e4ec1cd4 of volume 76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:36:09 devstack sudo[111275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4
Jun 26 00:36:09 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] snapshot_file for this snap is: volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be98da-52d0-47af-9d1b-00f453e07800]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.328s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:10 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Deleted volume successfully.
Jun 26 00:36:10 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9f9554c-0c23-4813-8bb2-dce8e36247dd tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-c804bc23-c3ae-45ce-892b-428051c1a630-delete_volume" released by "delete_volume" :: held 4.300s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:10 devstack sudo[111282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4
Jun 26 00:36:10 devstack sudo[111282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:10 devstack sudo[111260]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.584s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:10 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleted volume successfully.
Jun 26 00:36:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f67c4322-be7b-4c13-861f-cc61cda5cfbe tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-5a1af7e4-99a8-4b5a-bc4e-3156780e0613-delete_volume" released by "delete_volume" :: held 4.182s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:11 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4" returned: 0 in 1.312s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:11 devstack sudo[111310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4
Jun 26 00:36:11 devstack sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:11 devstack sudo[111282]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4" returned: 0 in 1.440s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76223616-f739-4800-afe0-c5cc8a7f606a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[95006212-1602-4c6c-b48e-dc3aa36d43d8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:11 devstack sudo[111317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a
Jun 26 00:36:11 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:11 devstack sudo[111310]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-aafac7d7-fa5d-4175-8c24-91f83e07d3b4" returned: 0 in 0.935s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-aafac7d7-fa5d-4175-8c24-91f83e07d3b4" released by "delete_volume" :: held 2.366s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created reservations ['8d35cfe8-d29a-4e9d-adec-be303f649c4a', 'e8875f48-79db-4594-a3b3-6e0eb4c25a93', '698ab43f-202b-408f-98bf-766b7b220c0b', 'adacb5e2-eee6-4982-932b-d78348eddc51'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:12 devstack sudo[111320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:12 devstack sudo[111320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:12 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a" returned: 0 in 0.967s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:12 devstack sudo[111325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4
Jun 26 00:36:12 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:12 devstack sudo[111320]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.717s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Deleted volume successfully.
Jun 26 00:36:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-66a8a7e0-fba2-4f0a-8693-d70ffcaf73fe tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-aafac7d7-fa5d-4175-8c24-91f83e07d3b4-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "cinder-quobyte-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[860a61cf-f87c-4e91-b9fa-c303f8464e4e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:13 devstack sudo[111328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a
Jun 26 00:36:13 devstack sudo[111328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:13 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4" returned: 0 in 0.969s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:13 devstack sudo[111333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4
Jun 26 00:36:13 devstack sudo[111333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:13 devstack sudo[111328]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a" returned: 0 in 0.798s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:13 devstack sudo[111338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a
Jun 26 00:36:13 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:14 devstack sudo[111333]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a.968d943e-82e3-4080-812a-7fc6e4ec1cd4" returned: 0 in 0.712s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-968d943e-82e3-4080-812a-7fc6e4ec1cd4" released by "_delete_snapshot" :: held 4.278s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-76223616-f739-4800-afe0-c5cc8a7f606a" released by "delete_snapshot" :: held 4.320s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['75b3f4fa-0b2a-42d1-91bf-9b8921c8dd85', 'a0afe06e-aa25-4e64-9841-e18ac550d271', '39165e27-36b8-4cc8-86a7-04728f0c994f', 'b3656b16-0fdf-4c61-8df1-95936370fc9d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Delete snapshot completed successfully.
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ab19e629-af49-462b-8ef9-60ee107b3bce tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-968d943e-82e3-4080-812a-7fc6e4ec1cd4-delete_snapshot" released by "delete_snapshot" :: held 4.499s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:14 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a" returned: 0 in 0.712s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-quobyte-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a" released by "delete_volume" :: held 1.551s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Created reservations ['e3ec24ca-47bb-4924-88ad-eadcddb6f3ce', '834e07ae-823a-4715-a70b-620954afc8fc', '89fd2609-9479-4519-9897-e3b3771ecda8', '737d66f5-4c4c-4cea-874d-7028346bd0ac'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:14 devstack sudo[111346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:14 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-76223616-f739-4800-afe0-c5cc8a7f606a-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-76223616-f739-4800-afe0-c5cc8a7f606a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "cinder-quobyte-76223616-f739-4800-afe0-c5cc8a7f606a" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-76223616-f739-4800-afe0-c5cc8a7f606a" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf16bc68-54df-46da-91cf-446f19c9cd66]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:15 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.743s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Deleted volume successfully.
Jun 26 00:36:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-405ae435-50f8-4bb8-99ee-1f994f7e5594 tempest-CreateVolumesFromSourceVolumeTest-1743432828 None] Lock "cinder-8b0a9a69-fa10-4999-9e5c-a3bf5b911a2a-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:15 devstack sudo[111349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a
Jun 26 00:36:15 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:16 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a" returned: 0 in 1.073s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:16 devstack sudo[111358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a
Jun 26 00:36:16 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:17 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-76223616-f739-4800-afe0-c5cc8a7f606a" returned: 0 in 1.246s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-quobyte-76223616-f739-4800-afe0-c5cc8a7f606a" released by "delete_volume" :: held 2.425s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:17 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Created reservations ['e7b910fd-dbbe-4e26-992b-cab733640641', 'b42b2154-f620-4ceb-8581-31a375a28d29', '5ca2d3d8-e470-40cb-98c4-6eaff41ed823', '2aad5ca6-d909-4928-825c-4aec50a56438'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:18 devstack sudo[111426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:18 devstack sudo[111426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:19 devstack sudo[111426]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.213s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:19 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Deleted volume successfully.
Jun 26 00:36:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-60ea3871-54bc-4cce-96fe-e28e9d2ed996 tempest-CreateVolumesFromSnapshotTest-1036719835 None] Lock "cinder-76223616-f739-4800-afe0-c5cc8a7f606a-delete_volume" released by "delete_volume" :: held 4.130s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Flow 'volume_create_manager' (6e110d96-a1c0-4a8d-a6b6-644b086a6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1229fa2-e076-4468-b864-9ea36793a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1229fa2-e076-4468-b864-9ea36793a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-928965665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a357b2-82b5-48cb-ab13-cdf66da43e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57b03e5dc6449c1a37a8ce119648b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:24Z,use_quota=True,user_id='be62fc02ae4e406cb75197b8208e4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d24c20e-5f26-4438-8535-78e63169fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d24c20e-5f26-4438-8535-78e63169fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff73ab78-3e7a-476b-b641-ffe40b8ad01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff73ab78-3e7a-476b-b641-ffe40b8ad01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a357b2-82b5-48cb-ab13-cdf66da43e32', 'volume_name': 'volume-32a357b2-82b5-48cb-ab13-cdf66da43e32', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3274dd-413c-4fe4-b49c-ac5de33fd957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3274dd-413c-4fe4-b49c-ac5de33fd957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39833f-c3bb-4c05-918d-9c2a9b6716d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Volume 32a357b2-82b5-48cb-ab13-cdf66da43e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a357b2-82b5-48cb-ab13-cdf66da43e32', 'volume_size': 1}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-928965665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a357b2-82b5-48cb-ab13-cdf66da43e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57b03e5dc6449c1a37a8ce119648b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:24Z,use_quota=True,user_id='be62fc02ae4e406cb75197b8208e4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Creating volume 32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:36:24 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:24 devstack sudo[111461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 1073741824
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:36:24 devstack sudo[111461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Flow 'volume_create_manager' (b6c68e4a-e1ee-4768-a09f-363f94188608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51093731-3d67-4e05-b6b0-96e7c63fabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51093731-3d67-4e05-b6b0-96e7c63fabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-804324981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4194794-7757-4013-b507-143fc239bd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc72240a6b344b79be14df99254bbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:24Z,use_quota=True,user_id='ea7aed7170954ad29f8c7d0fcd1685c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b27509b-31f8-42b0-93ff-0f0d4af93108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b27509b-31f8-42b0-93ff-0f0d4af93108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28242455-95cd-46bc-9c04-6bfdf6b91448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28242455-95cd-46bc-9c04-6bfdf6b91448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4194794-7757-4013-b507-143fc239bd8b', 'volume_name': 'volume-c4194794-7757-4013-b507-143fc239bd8b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bed8adc-c138-49c3-8906-8fa17eb7a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bed8adc-c138-49c3-8906-8fa17eb7a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f3e4f-8dea-46c9-bb48-6b17bdaa713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Volume c4194794-7757-4013-b507-143fc239bd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4194794-7757-4013-b507-143fc239bd8b', 'volume_size': 1}
Jun 26 00:36:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:25 devstack sudo[111461]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 1073741824" returned: 0 in 1.217s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:25 devstack sudo[111470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:36:25 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:26 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 0.885s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-804324981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4194794-7757-4013-b507-143fc239bd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc72240a6b344b79be14df99254bbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:24Z,use_quota=True,user_id='ea7aed7170954ad29f8c7d0fcd1685c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Creating volume c4194794-7757-4013-b507-143fc239bd8b {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:36:26 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39833f-c3bb-4c05-918d-9c2a9b6716d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a357b2-82b5-48cb-ab13-cdf66da43e32', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703c5341-b5b1-4862-8764-a5741e3c7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:26 devstack sudo[111473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b 1073741824
Jun 26 00:36:26 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Volume volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 (32a357b2-82b5-48cb-ab13-cdf66da43e32): created successfully
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703c5341-b5b1-4862-8764-a5741e3c7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Flow 'volume_create_manager' (6e110d96-a1c0-4a8d-a6b6-644b086a6e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-104dc78a-7aa9-441c-8543-1fd1202f24f1 tempest-VolumeDependencyTests-244731336 None] Created volume successfully.
Jun 26 00:36:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:28 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b 1073741824" returned: 0 in 2.030s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:28 devstack sudo[111577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b
Jun 26 00:36:28 devstack sudo[111577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:30 devstack sudo[111577]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b" returned: 0 in 1.765s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] <== create_volume: return (3943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.947s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.482s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f3e4f-8dea-46c9-bb48-6b17bdaa713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4194794-7757-4013-b507-143fc239bd8b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c7fb2d-8511-49f6-a7e2-cb9a60625285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Creating offline snapshot 26d1a834-35c2-47ff-871c-1c65f86b9082 of volume 32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:36:30 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Volume volume-c4194794-7757-4013-b507-143fc239bd8b (c4194794-7757-4013-b507-143fc239bd8b): created successfully
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c7fb2d-8511-49f6-a7e2-cb9a60625285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Flow 'volume_create_manager' (b6c68e4a-e1ee-4768-a09f-363f94188608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[212c98a1-e381-4d0f-b555-8d90468e070d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bc05871b-c5e0-4bbd-a525-a8fae6710a77 tempest-TestMinimumBasicScenario-1193251744 None] Created volume successfully.
Jun 26 00:36:31 devstack sudo[111599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:36:31 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:32 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 2.037s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:32 devstack sudo[111643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 1G
Jun 26 00:36:32 devstack sudo[111643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:34 devstack sudo[111643]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 1G" returned: 0 in 1.200s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:34 devstack sudo[111650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082
Jun 26 00:36:34 devstack sudo[111650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (43377114-c2b7-44c3-817a-a13de488c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee96382-3385-4875-a9d9-cf2dd6b2e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee96382-3385-4875-a9d9-cf2dd6b2e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1923509927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd0f511-effe-413a-b1ab-e67c456203c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:34Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb89cead-25a1-421c-85bf-1aae0d4a4170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb89cead-25a1-421c-85bf-1aae0d4a4170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30daad7-3920-4819-a15f-5b51b0faf3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30daad7-3920-4819-a15f-5b51b0faf3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd0f511-effe-413a-b1ab-e67c456203c4', 'volume_name': 'volume-4bd0f511-effe-413a-b1ab-e67c456203c4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e22812-1cb7-4f42-b93b-ed1a28f9f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e22812-1cb7-4f42-b93b-ed1a28f9f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee39844-2621-4be8-8c8c-ce99ba9eb3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Volume 4bd0f511-effe-413a-b1ab-e67c456203c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd0f511-effe-413a-b1ab-e67c456203c4', 'volume_size': 1}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:35 devstack sudo[111650]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082" returned: 0 in 0.954s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:35 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 is being set with open permissions: ugo+rw
Jun 26 00:36:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:35 devstack sudo[111665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082
Jun 26 00:36:35 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:35 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082" returned: 0 in 0.741s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:35 devstack sudo[111668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info
Jun 26 00:36:35 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info" returned: 0 in 0.852s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:36 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info is being set with open permissions: ugo+rw
Jun 26 00:36:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:36 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:36 devstack sudo[111671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info
Jun 26 00:36:36 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:37 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.info" returned: 0 in 0.784s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.745s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.983s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1923509927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd0f511-effe-413a-b1ab-e67c456203c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:34Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Creating volume 4bd0f511-effe-413a-b1ab-e67c456203c4 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:36:37 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:36:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:37 devstack sudo[111674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4 1073741824
Jun 26 00:36:37 devstack sudo[111674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-27f8f549-6cdc-4e8d-a4a6-88d450e7a7b4 tempest-VolumeDependencyTests-244731336 None] Create snapshot completed successfully
Jun 26 00:36:38 devstack sudo[111674]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4 1073741824" returned: 0 in 1.180s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Flow 'volume_create_manager' (c48a037e-ddd0-4553-b7fd-f4f6ea1365f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:38 devstack sudo[111681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4
Jun 26 00:36:38 devstack sudo[111681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c00f5ad-9fe8-4130-b2f4-f7437e636cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c00f5ad-9fe8-4130-b2f4-f7437e636cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-114112977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0928dc-ef9a-4828-abff-14ce81020918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57b03e5dc6449c1a37a8ce119648b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26d1a834-35c2-47ff-871c-1c65f86b9082,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:39Z,use_quota=True,user_id='be62fc02ae4e406cb75197b8208e4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a741ffc5-9d42-40c4-ba7e-3f79b74af7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a741ffc5-9d42-40c4-ba7e-3f79b74af7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7a9200-445d-4f79-98b7-a643f3f4d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7a9200-445d-4f79-98b7-a643f3f4d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb0928dc-ef9a-4828-abff-14ce81020918', 'volume_name': 'volume-fb0928dc-ef9a-4828-abff-14ce81020918', 'volume_size': 1, 'snapshot_id': '26d1a834-35c2-47ff-871c-1c65f86b9082'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca09c37-1b81-41ef-b433-d3f17b4b6cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca09c37-1b81-41ef-b433-d3f17b4b6cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d36044-80ef-462f-adc6-ab55ba76478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:38 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Volume fb0928dc-ef9a-4828-abff-14ce81020918: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb0928dc-ef9a-4828-abff-14ce81020918', 'volume_size': 1, 'snapshot_id': '26d1a834-35c2-47ff-871c-1c65f86b9082'}
Jun 26 00:36:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:39 devstack sudo[111681]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4" returned: 0 in 1.009s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.745s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee39844-2621-4be8-8c8c-ce99ba9eb3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd0f511-effe-413a-b1ab-e67c456203c4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b229f8e-888f-46d5-80d9-745040a1534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[662a2d72-f392-44dc-8981-53875bb19ea0]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:39 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Volume volume-4bd0f511-effe-413a-b1ab-e67c456203c4 (4bd0f511-effe-413a-b1ab-e67c456203c4): created successfully
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b229f8e-888f-46d5-80d9-745040a1534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:39 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (43377114-c2b7-44c3-817a-a13de488c871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8c47e0bf-e74f-4a19-87b0-77c3014aedd9 tempest-VolumesActionsTest-1327290416 None] Created volume successfully.
Jun 26 00:36:39 devstack sudo[111684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b
Jun 26 00:36:39 devstack sudo[111684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:40 devstack sudo[111684]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b" returned: 0 in 1.081s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.128s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.934s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-quobyte-26d1a834-35c2-47ff-871c-1c65f86b9082-fb0928dc-ef9a-4828-abff-14ce81020918" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-26d1a834-35c2-47ff-871c-1c65f86b9082-fb0928dc-ef9a-4828-abff-14ce81020918" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Creating volume fb0928dc-ef9a-4828-abff-14ce81020918 from snapshot 26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-quobyte-fb0928dc-ef9a-4828-abff-14ce81020918" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc5a86f0-ec2e-4154-8d29-759b04aa270e tempest-VolumesActionsTest-1327290416 None] Acquiring lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4" by "attach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-fb0928dc-ef9a-4828-abff-14ce81020918" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] snapshot: 26d1a834-35c2-47ff-871c-1c65f86b9082, volume: fb0928dc-ef9a-4828-abff-14ce81020918,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:36:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc5a86f0-ec2e-4154-8d29-759b04aa270e tempest-VolumesActionsTest-1327290416 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4" acquired by "attach_volume" :: waited 0.076s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-c4194794-7757-4013-b507-143fc239bd8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9afd269-1bb9-4cd7-a0b3-6a216b30119d', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd39ea6-0b67-4bcc-bf01-7a1243d6cf7c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:41 devstack sudo[111689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082
Jun 26 00:36:41 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fc5a86f0-ec2e-4154-8d29-759b04aa270e tempest-VolumesActionsTest-1327290416 None] Attaching volume 4bd0f511-effe-413a-b1ab-e67c456203c4 to instance 45532565-b76c-47c1-91a0-5b35ed6f7960 at mountpoint /dev/vdb on host None.
Jun 26 00:36:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-a82cf154-679d-4f73-9a41-0c51ed385433 req-283f8afd-f93a-4b45-a298-65cb5e5a58ae tempest-TestMinimumBasicScenario-1193251744 None] attachment_update completed successfully.
Jun 26 00:36:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fc5a86f0-ec2e-4154-8d29-759b04aa270e tempest-VolumesActionsTest-1327290416 None] Attach volume completed successfully.
Jun 26 00:36:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc5a86f0-ec2e-4154-8d29-759b04aa270e tempest-VolumesActionsTest-1327290416 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4" released by "attach_volume" :: held 0.357s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:42 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082" returned: 0 in 1.242s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a357b2-82b5-48cb-ab13-cdf66da43e32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:36:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:36:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:36:42 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[49067bc0-0c17-4d4a-b93d-ed11c7874636]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:42 devstack sudo[111761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:36:42 devstack sudo[111761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6b9202a0-a9af-4a3b-9f48-6b5cb262ad97 tempest-VolumesActionsTest-1115159517 None] Terminate volume connection completed successfully.
Jun 26 00:36:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6b9202a0-a9af-4a3b-9f48-6b5cb262ad97 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-detach_volume" by "detach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6b9202a0-a9af-4a3b-9f48-6b5cb262ad97 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6b9202a0-a9af-4a3b-9f48-6b5cb262ad97 tempest-VolumesActionsTest-1115159517 None] Detaching volume 4bd0f511-effe-413a-b1ab-e67c456203c4 from instance 45532565-b76c-47c1-91a0-5b35ed6f7960.
Jun 26 00:36:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6b9202a0-a9af-4a3b-9f48-6b5cb262ad97 tempest-VolumesActionsTest-1115159517 None] Detach volume completed successfully.
Jun 26 00:36:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6b9202a0-a9af-4a3b-9f48-6b5cb262ad97 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:43 devstack sudo[111761]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 1.413s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:43 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:36:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:43 devstack sudo[112105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918
Jun 26 00:36:43 devstack sudo[112105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ee86fc96-bdef-42de-99f9-777e98365d15 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-detach_volume" by "detach_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ee86fc96-bdef-42de-99f9-777e98365d15 tempest-VolumesActionsTest-1327290416 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:44 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ee86fc96-bdef-42de-99f9-777e98365d15 tempest-VolumesActionsTest-1327290416 None] Volume detach called, but volume not attached.
Jun 26 00:36:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ee86fc96-bdef-42de-99f9-777e98365d15 tempest-VolumesActionsTest-1327290416 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Acquiring lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:44 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Acquiring lock "cinder-quobyte-4bd0f511-effe-413a-b1ab-e67c456203c4" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Lock "cinder-quobyte-4bd0f511-effe-413a-b1ab-e67c456203c4" acquired by "delete_volume" :: waited 0.052s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:45 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c015f-8bd5-46ff-a8fa-5164585468ee]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:45 devstack sudo[112118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4
Jun 26 00:36:45 devstack sudo[112118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:47 devstack sudo[112118]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4" returned: 0 in 2.192s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:47 devstack sudo[112124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4
Jun 26 00:36:47 devstack sudo[112124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:49 devstack sudo[112124]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4bd0f511-effe-413a-b1ab-e67c456203c4" returned: 0 in 1.687s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Lock "cinder-quobyte-4bd0f511-effe-413a-b1ab-e67c456203c4" released by "delete_volume" :: held 4.051s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Created reservations ['0c2abf74-69c8-4f53-b4dc-891bcaa9993d', '8da0e4c1-57f2-43d1-b7de-13681dc228ba', '21c98729-2d0c-4ea5-b6b5-280b0ba70f16', '02857123-f61d-4ba1-947e-422e5cff71ff'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:49 devstack sudo[112127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:36:49 devstack sudo[112127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:50 devstack sudo[112105]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918" returned: 0 in 7.035s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:50 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ae5846-ca4e-4930-810d-150463756bf9]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:50 devstack sudo[112127]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.243s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:50 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:36:50 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Deleted volume successfully.
Jun 26 00:36:50 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d9f31827-97cd-49b0-81ce-86854113702b tempest-VolumesActionsTest-1327290416 None] Lock "cinder-4bd0f511-effe-413a-b1ab-e67c456203c4-delete_volume" released by "delete_volume" :: held 6.021s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:50 devstack sudo[112130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:36:50 devstack sudo[112130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:52 devstack sudo[112130]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 1.582s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:52 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:36:52 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Converted 1024.00 MB image at 145.52 MB/s
Jun 26 00:36:52 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 is being set with open permissions: ugo+rw
Jun 26 00:36:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:52 devstack sudo[112217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918
Jun 26 00:36:52 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:53 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918" returned: 0 in 0.809s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-fb0928dc-ef9a-4828-abff-14ce81020918" released by "_copy_volume_from_snapshot" :: held 12.248s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-26d1a834-35c2-47ff-871c-1c65f86b9082-fb0928dc-ef9a-4828-abff-14ce81020918" released by "_create_volume_from_snapshot" :: held 12.330s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.371s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d36044-80ef-462f-adc6-ab55ba76478f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0928dc-ef9a-4828-abff-14ce81020918', 'volume_size': 1, 'snapshot_id': '26d1a834-35c2-47ff-871c-1c65f86b9082'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ff3bea-9fd1-48c9-a0ad-b6e9d30b2ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:53 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Volume volume-fb0928dc-ef9a-4828-abff-14ce81020918 (fb0928dc-ef9a-4828-abff-14ce81020918): created successfully
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ff3bea-9fd1-48c9-a0ad-b6e9d30b2ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Flow 'volume_create_manager' (c48a037e-ddd0-4553-b7fd-f4f6ea1365f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-616ee98f-c361-4ca6-8a71-c60dfd8abf8c tempest-VolumeDependencyTests-244731336 None] Created volume successfully.
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-26d1a834-35c2-47ff-871c-1c65f86b9082-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-26d1a834-35c2-47ff-871c-1c65f86b9082-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-quobyte-32a357b2-82b5-48cb-ab13-cdf66da43e32" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-32a357b2-82b5-48cb-ab13-cdf66da43e32" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-quobyte-26d1a834-35c2-47ff-871c-1c65f86b9082" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-26d1a834-35c2-47ff-871c-1c65f86b9082" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Deleting offline snapshot 26d1a834-35c2-47ff-871c-1c65f86b9082 of volume 32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] snapshot_file for this snap is: volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc8619-ba01-4628-b2f4-a2e3e76ea00b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:53 devstack sudo[112232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082
Jun 26 00:36:53 devstack sudo[112232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:54 devstack sudo[112232]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082" returned: 0 in 0.993s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a357b2-82b5-48cb-ab13-cdf66da43e32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:36:54 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abc2c1b-ab7b-46fd-8625-8a346042b6cc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:54 devstack sudo[112241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:36:54 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:55 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 1.023s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:55 devstack sudo[112250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082
Jun 26 00:36:55 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:56 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082" returned: 0 in 0.947s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:56 devstack sudo[112257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082
Jun 26 00:36:56 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:57 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32.26d1a834-35c2-47ff-871c-1c65f86b9082" returned: 0 in 0.935s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-26d1a834-35c2-47ff-871c-1c65f86b9082" released by "_delete_snapshot" :: held 4.104s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-32a357b2-82b5-48cb-ab13-cdf66da43e32" released by "delete_snapshot" :: held 4.150s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:57 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Created reservations ['e1e7f4df-828b-4d94-ad94-bbf5f89ddc53', '5d12167c-0257-4bd0-80e6-9fccf5a7a9f7', '62eecf5a-53eb-4b69-96bf-636a270be76e', '89437c0d-ac76-4e2d-a416-a30833e25dbf'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:36:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Delete snapshot completed successfully.
Jun 26 00:36:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-9790283c-5635-4c2e-89cc-bc1ee0e30c86 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-26d1a834-35c2-47ff-871c-1c65f86b9082-delete_snapshot" released by "delete_snapshot" :: held 4.364s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Flow 'volume_create_manager' (484de50f-9c87-412d-8e01-e35a4e2adca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7582abc-8324-479d-a52a-29135801ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7582abc-8324-479d-a52a-29135801ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-512542143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3a1fdd-1233-487f-8e5d-e573a6ba427f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0472d2eb1c40445facfaf913e738707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:58Z,use_quota=True,user_id='d72d94b9a7b64ad2af63a2bf0c4c9d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a1277f-4fb4-44e3-8128-382afc8374d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a1277f-4fb4-44e3-8128-382afc8374d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea73084-0a17-4401-9157-c91b31c340ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea73084-0a17-4401-9157-c91b31c340ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3a1fdd-1233-487f-8e5d-e573a6ba427f', 'volume_name': 'volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2cffeb-6565-484d-8f84-e1d3b420b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2cffeb-6565-484d-8f84-e1d3b420b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8852d8c4-42b3-486d-994e-a932e05b4849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Volume 8b3a1fdd-1233-487f-8e5d-e573a6ba427f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f', 'volume_size': 1}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-512542143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3a1fdd-1233-487f-8e5d-e573a6ba427f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0472d2eb1c40445facfaf913e738707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:58Z,use_quota=True,user_id='d72d94b9a7b64ad2af63a2bf0c4c9d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Creating volume 8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:36:58 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:58 devstack sudo[112267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f 1073741824
Jun 26 00:36:58 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=118,cinder:SELECT=94,cinder:INSERT=32,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=87,cinder:INSERT=26,cinder:DELETE=11,cinder:UPDATE=116 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (fb3610b3-46ac-46bd-af09-1f295ea6a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6e9ba6-17ce-4b32-aafa-95da63658859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-32a357b2-82b5-48cb-ab13-cdf66da43e32-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6e9ba6-17ce-4b32-aafa-95da63658859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1510472204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e308acc3-0481-4bfa-865d-3e0f019f3874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:59Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9ae641-1b8b-4b2a-a98f-bf72a4d257a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9ae641-1b8b-4b2a-a98f-bf72a4d257a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d2dfbb-1a56-48bf-85cf-9c7c9335e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d2dfbb-1a56-48bf-85cf-9c7c9335e073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e308acc3-0481-4bfa-865d-3e0f019f3874', 'volume_name': 'volume-e308acc3-0481-4bfa-865d-3e0f019f3874', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b92f03-5417-4fa2-9c25-3d3dd2267c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b92f03-5417-4fa2-9c25-3d3dd2267c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a61206c-405d-4d62-b58f-b4d2cb9e7294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:36:59 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Volume e308acc3-0481-4bfa-865d-3e0f019f3874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e308acc3-0481-4bfa-865d-3e0f019f3874', 'volume_size': 1}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-32a357b2-82b5-48cb-ab13-cdf66da43e32-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-quobyte-32a357b2-82b5-48cb-ab13-cdf66da43e32" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-32a357b2-82b5-48cb-ab13-cdf66da43e32" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad21ac78-dc27-485b-be55-e6cd336c3932]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:59 devstack sudo[112274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:36:59 devstack sudo[112274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:36:59 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f 1073741824" returned: 0 in 1.102s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:36:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:36:59 devstack sudo[112278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:36:59 devstack sudo[112278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:00 devstack sudo[112274]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 0.932s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:00 devstack sudo[112284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32
Jun 26 00:37:00 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:00 devstack sudo[112278]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 0.789s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1510472204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e308acc3-0481-4bfa-865d-3e0f019f3874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:36:59Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Creating volume e308acc3-0481-4bfa-865d-3e0f019f3874 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:00 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8852d8c4-42b3-486d-994e-a932e05b4849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:00 devstack sudo[112286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874 1073741824
Jun 26 00:37:00 devstack sudo[112286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83dbefa-6763-447b-8cbb-2d84243864c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Volume volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f (8b3a1fdd-1233-487f-8e5d-e573a6ba427f): created successfully
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83dbefa-6763-447b-8cbb-2d84243864c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Flow 'volume_create_manager' (484de50f-9c87-412d-8e01-e35a4e2adca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b35d0f3b-8e39-44a8-91ce-391061b9ec0c tempest-SnapshotDependencyTests-1326524551 None] Created volume successfully.
Jun 26 00:37:00 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-32a357b2-82b5-48cb-ab13-cdf66da43e32" returned: 0 in 0.719s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-32a357b2-82b5-48cb-ab13-cdf66da43e32" released by "delete_volume" :: held 1.724s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Created reservations ['38796025-7c9d-4143-9756-f3f28a36e502', 'e36a7c97-de4b-46f8-859b-a38b1da456f2', '8fcde894-6b38-440e-9301-df1c55602d59', 'b0309a33-118f-4c0c-aaf9-e3470c9018c9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:00 devstack sudo[112293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:00 devstack sudo[112293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:01 devstack sudo[112295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:01 devstack sudo[112295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:01 devstack sudo[112286]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874 1073741824" returned: 0 in 0.928s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:01 devstack sudo[112297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874
Jun 26 00:37:01 devstack sudo[112297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-fb0928dc-ef9a-4828-abff-14ce81020918-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Lock "cinder-fb0928dc-ef9a-4828-abff-14ce81020918-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Acquiring lock "cinder-quobyte-fb0928dc-ef9a-4828-abff-14ce81020918" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-fb0928dc-ef9a-4828-abff-14ce81020918" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d850ce43-35ee-4f85-8ffb-dc209ee73390]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:01 devstack sudo[112299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918
Jun 26 00:37:01 devstack sudo[112299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:01 devstack sudo[112293]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.975s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Deleted volume successfully.
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1d16957-3b4f-4656-bc90-99e2f6f8b262 tempest-VolumeDependencyTests-244731336 None] Lock "cinder-32a357b2-82b5-48cb-ab13-cdf66da43e32-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:02 devstack sudo[112295]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.092s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:37:02 devstack sudo[112297]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874" returned: 0 in 1.130s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.346s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a61206c-405d-4d62-b58f-b4d2cb9e7294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e308acc3-0481-4bfa-865d-3e0f019f3874', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed2a65-58b2-44b0-a5a2-44c0ba219b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Creating offline snapshot 6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 of volume 8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:37:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Volume volume-e308acc3-0481-4bfa-865d-3e0f019f3874 (e308acc3-0481-4bfa-865d-3e0f019f3874): created successfully
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed2a65-58b2-44b0-a5a2-44c0ba219b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (fb3610b3-46ac-46bd-af09-1f295ea6a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e27ea3-4adb-499c-9dc8-e9d0ac93a7bf]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8097ebb8-377f-42a4-b3f1-8126e04238e9 tempest-VolumesActionsTest-1327290416 None] Created volume successfully.
Jun 26 00:37:02 devstack sudo[112334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:37:02 devstack sudo[112334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:02 devstack sudo[112299]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918" returned: 0 in 1.032s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:02 devstack sudo[112339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918
Jun 26 00:37:02 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:03 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-fb0928dc-ef9a-4828-abff-14ce81020918" returned: 0 in 0.705s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Lock "cinder-quobyte-fb0928dc-ef9a-4828-abff-14ce81020918" released by "delete_volume" :: held 1.842s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-e308acc3-0481-4bfa-865d-3e0f019f3874-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Lock "cinder-e308acc3-0481-4bfa-865d-3e0f019f3874-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:03 devstack sudo[112334]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 0.963s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-quobyte-e308acc3-0481-4bfa-865d-3e0f019f3874" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Created reservations ['0f924db7-f90a-4af3-96b7-d78f14778e5f', 'b7f2764b-cfc6-49e2-a04d-aa570b5fbed3', 'f8f95c01-c7ff-494e-bfda-facb397191ff', '6098825b-976e-46a0-9d65-612c7a0f6f0b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:03 devstack sudo[112345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 1G
Jun 26 00:37:03 devstack sudo[112345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-e308acc3-0481-4bfa-865d-3e0f019f3874" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[87035394-0365-4a6d-a91f-36c4e28de9c3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:03 devstack sudo[112348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:03 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:03 devstack sudo[112347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874
Jun 26 00:37:03 devstack sudo[112347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:04 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.028s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:04 devstack sudo[112345]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 1G" returned: 0 in 1.200s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Deleted volume successfully.
Jun 26 00:37:04 devstack sudo[112362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1
Jun 26 00:37:04 devstack sudo[112362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4235c952-f788-4520-a0bc-875320d447eb tempest-VolumeDependencyTests-244731336 None] Lock "cinder-fb0928dc-ef9a-4828-abff-14ce81020918-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:04 devstack sudo[112347]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874" returned: 0 in 1.206s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:04 devstack sudo[112364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874
Jun 26 00:37:04 devstack sudo[112364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:05 devstack sudo[112364]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e308acc3-0481-4bfa-865d-3e0f019f3874" returned: 0 in 0.753s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-e308acc3-0481-4bfa-865d-3e0f019f3874" released by "delete_volume" :: held 2.016s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Created reservations ['5a104af9-d1c2-466e-8c39-0d2128b43e0a', 'c7f166fc-b551-409c-b238-4cce425de297', '80165fe5-e720-46f1-9cdb-c9c4776a8ed8', '1aab6c40-68c7-4d21-ab2f-afec3a917c83'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:05 devstack sudo[112362]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" returned: 0 in 1.001s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:05 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 is being set with open permissions: ugo+rw
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:05 devstack sudo[112370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1
Jun 26 00:37:05 devstack sudo[112370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:05 devstack sudo[112372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:05 devstack sudo[112372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:06 devstack sudo[112370]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" returned: 0 in 0.747s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:06 devstack sudo[112372]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.709s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:06 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:06 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Deleted volume successfully.
Jun 26 00:37:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bde29032-9146-4116-a513-2e5c399567ab tempest-VolumesActionsTest-1115159517 None] Lock "cinder-e308acc3-0481-4bfa-865d-3e0f019f3874-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:06 devstack sudo[112376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info
Jun 26 00:37:06 devstack sudo[112376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:07 devstack sudo[112376]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info" returned: 0 in 0.944s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:07 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info is being set with open permissions: ugo+rw
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:07 devstack sudo[112405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info
Jun 26 00:37:07 devstack sudo[112405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (dc616712-df3c-42ae-8da2-9d8bb9e45bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed46b46-9dea-41d4-a6e0-62cb73d162a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed46b46-9dea-41d4-a6e0-62cb73d162a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1144902429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb1b01b-04df-402e-a010-a04cdb420792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:07Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3115b77f-9702-4353-8d6c-651824ddeffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3115b77f-9702-4353-8d6c-651824ddeffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a2fe96-8122-4a39-b299-1fe8481a5e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a2fe96-8122-4a39-b299-1fe8481a5e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb1b01b-04df-402e-a010-a04cdb420792', 'volume_name': 'volume-3fb1b01b-04df-402e-a010-a04cdb420792', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb96931-bfae-42ba-a175-db7b82674ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb96931-bfae-42ba-a175-db7b82674ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7311cb50-4805-4ece-b4c3-e131c72a7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:07 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Volume 3fb1b01b-04df-402e-a010-a04cdb420792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb1b01b-04df-402e-a010-a04cdb420792', 'volume_size': 1}
Jun 26 00:37:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:08 devstack sudo[112405]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.info" returned: 0 in 0.982s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.984s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1144902429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb1b01b-04df-402e-a010-a04cdb420792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:07Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Creating volume 3fb1b01b-04df-402e-a010-a04cdb420792 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:08 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:08 devstack sudo[112440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792 1073741824
Jun 26 00:37:08 devstack sudo[112440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d889e48d-2707-4729-9046-2ca9ffbeedc0 tempest-SnapshotDependencyTests-1326524551 None] Create snapshot completed successfully
Jun 26 00:37:09 devstack sudo[112440]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792 1073741824" returned: 0 in 1.562s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:10 devstack sudo[112512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792
Jun 26 00:37:10 devstack sudo[112512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Flow 'volume_create_manager' (592f7f16-e4d9-448c-a50a-898828767882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2051e6d-cee3-4f36-b6e8-b873896e515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2051e6d-cee3-4f36-b6e8-b873896e515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73a743a-7228-445e-9147-cbad075a2199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0472d2eb1c40445facfaf913e738707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6e5e6be0-c988-4cc2-aac3-b63be0edcbe1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:11Z,use_quota=True,user_id='d72d94b9a7b64ad2af63a2bf0c4c9d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfac38e-40aa-4f3a-b287-450c84312a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfac38e-40aa-4f3a-b287-450c84312a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf1de6a-0ee6-4b99-aa72-26ee8d67f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf1de6a-0ee6-4b99-aa72-26ee8d67f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd73a743a-7228-445e-9147-cbad075a2199', 'volume_name': 'volume-d73a743a-7228-445e-9147-cbad075a2199', 'volume_size': 1, 'snapshot_id': '6e5e6be0-c988-4cc2-aac3-b63be0edcbe1'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045b6565-1feb-4374-86fd-7731580f04fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045b6565-1feb-4374-86fd-7731580f04fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76507f44-1e3b-4a3c-af35-ae01dbb65f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:10 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Volume d73a743a-7228-445e-9147-cbad075a2199: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d73a743a-7228-445e-9147-cbad075a2199', 'volume_size': 1, 'snapshot_id': '6e5e6be0-c988-4cc2-aac3-b63be0edcbe1'}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:10 devstack sudo[112512]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792" returned: 0 in 0.961s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] <== create_volume: return (2576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.150s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-quobyte-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1-d73a743a-7228-445e-9147-cbad075a2199" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7311cb50-4805-4ece-b4c3-e131c72a7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb1b01b-04df-402e-a010-a04cdb420792', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8814b56d-a269-4225-9545-f695fb35c6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1-d73a743a-7228-445e-9147-cbad075a2199" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Creating volume d73a743a-7228-445e-9147-cbad075a2199 from snapshot 6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-quobyte-d73a743a-7228-445e-9147-cbad075a2199" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:11 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Volume volume-3fb1b01b-04df-402e-a010-a04cdb420792 (3fb1b01b-04df-402e-a010-a04cdb420792): created successfully
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8814b56d-a269-4225-9545-f695fb35c6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (dc616712-df3c-42ae-8da2-9d8bb9e45bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-d73a743a-7228-445e-9147-cbad075a2199" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] snapshot: 6e5e6be0-c988-4cc2-aac3-b63be0edcbe1, volume: d73a743a-7228-445e-9147-cbad075a2199,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a39412a1-2a03-47d6-8bdd-7cfab5383152 tempest-VolumesActionsTest-1327290416 None] Created volume successfully.
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9774631f-a1d8-49f8-be9e-064426331db8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:11 devstack sudo[112517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1
Jun 26 00:37:11 devstack sudo[112517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-3fb1b01b-04df-402e-a010-a04cdb420792-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Lock "cinder-3fb1b01b-04df-402e-a010-a04cdb420792-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:12 devstack sudo[112517]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" returned: 0 in 1.029s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Flow 'volume_create_manager' (374f64ad-49b5-49ab-b7b3-b4494c760543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a90ff85-e6df-4a62-a708-95fe91e49d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[da41e8ed-aec8-4740-8e7f-e84e611cfb3a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a90ff85-e6df-4a62-a708-95fe91e49d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34fc058-2bd5-4af6-b30a-e5f6de57fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617f0e1c7c3d41ae92b83004e742bc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:12Z,use_quota=True,user_id='398f720706244d428e8befb8c00147fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ec2f75-dcd9-4831-94c3-b740a924219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ec2f75-dcd9-4831-94c3-b740a924219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb6467e-9a17-461e-a868-c2ecbccb8f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-quobyte-3fb1b01b-04df-402e-a010-a04cdb420792" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-3fb1b01b-04df-402e-a010-a04cdb420792" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:12 devstack sudo[112522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:37:12 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbd1990-db24-4002-b5c7-960c64f20cb8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:12 devstack sudo[112524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792
Jun 26 00:37:12 devstack sudo[112524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb6467e-9a17-461e-a868-c2ecbccb8f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c34fc058-2bd5-4af6-b30a-e5f6de57fa53', 'volume_name': 'volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53', 'volume_size': 1, 'image_id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f92c3c12-d8df-4308-a56f-124c85e03f1c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '690dee7b8dd241bdbc85c4fdbde1cb97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '617f0e1c7c3d41ae92b83004e742bc29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7b5f344e6364954c4739cd74512f4c0b917bed4b45f4e629b817ee8f516903663a5d8dd38070549bc8c23086655af1bfcb2f2397518f7bfee596f8d1d6760d4c', 'id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'created_at': datetime.datetime(2026, 6, 25, 22, 37, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 37, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f92c3c12-d8df-4308-a56f-124c85e03f1c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459c07e00>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271503a2-887e-48ba-a169-d536df6aebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271503a2-887e-48ba-a169-d536df6aebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600e5e40-eef0-4c2c-8b51-e431b19bb3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:12 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Volume c34fc058-2bd5-4af6-b30a-e5f6de57fa53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53', 'volume_size': 1, 'image_id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f92c3c12-d8df-4308-a56f-124c85e03f1c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '690dee7b8dd241bdbc85c4fdbde1cb97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '617f0e1c7c3d41ae92b83004e742bc29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7b5f344e6364954c4739cd74512f4c0b917bed4b45f4e629b817ee8f516903663a5d8dd38070549bc8c23086655af1bfcb2f2397518f7bfee596f8d1d6760d4c', 'id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'created_at': datetime.datetime(2026, 6, 25, 22, 37, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 37, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f92c3c12-d8df-4308-a56f-124c85e03f1c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459c07e00>}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Trying to clone c34fc058-2bd5-4af6-b30a-e5f6de57fa53 from image f92c3c12-d8df-4308-a56f-124c85e03f1c at location (None, [{'url': 'file:///opt/stack/data/glance/images/f92c3c12-d8df-4308-a56f-124c85e03f1c', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:37:12 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[df093f06-b5db-4b36-b7f1-49962b00ca63]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:13 devstack sudo[112526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD
Jun 26 00:37:13 devstack sudo[112526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:13 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 1.167s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:13 devstack sudo[112535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199
Jun 26 00:37:13 devstack sudo[112535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:13 devstack sudo[112524]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792" returned: 0 in 1.091s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:13 devstack sudo[112537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792
Jun 26 00:37:13 devstack sudo[112537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:13 devstack sudo[112526]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD" returned: 0 in 0.882s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:13 devstack sudo[112541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD
Jun 26 00:37:13 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:14 devstack sudo[112537]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-3fb1b01b-04df-402e-a010-a04cdb420792" returned: 0 in 0.679s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-3fb1b01b-04df-402e-a010-a04cdb420792" released by "delete_volume" :: held 1.833s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Created reservations ['12655288-d97b-462e-92d4-a361c9dd1586', '6f101eb6-51cd-4cca-ac6b-89b3e9f3a169', '82cb12eb-d020-4d89-86bf-873a8977a5bf', '81a87d98-56c0-46e5-8697-946da32e48f9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:14 devstack sudo[112549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:14 devstack sudo[112549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:15 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD" returned: 1 in 1.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:37:15 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Temporary image f92c3c12-d8df-4308-a56f-124c85e03f1c is fetched for user 398f720706244d428e8befb8c00147fa. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:37:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d148907-23a9-40fd-836e-a22c4862e4d0]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:16 devstack sudo[112560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD
Jun 26 00:37:16 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:16 devstack sudo[112549]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 2.572s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:16 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Deleted volume successfully.
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-1bf48694-4169-496b-9671-41000c81a10b tempest-VolumesActionsTest-1115159517 None] Lock "cinder-3fb1b01b-04df-402e-a010-a04cdb420792-delete_volume" released by "delete_volume" :: held 4.849s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (eb87bffe-171d-4bc8-8523-609c0c4a6d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a90a73-8c44-432b-ad66-85bb4bb55b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a90a73-8c44-432b-ad66-85bb4bb55b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-712406605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9218ff7c-da43-4165-a78e-325ca2b944b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:17Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f3e596-4f90-400b-909a-98dc7dd58a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f3e596-4f90-400b-909a-98dc7dd58a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b299b8-6e33-496f-9e02-9ab8470e220f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b299b8-6e33-496f-9e02-9ab8470e220f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9218ff7c-da43-4165-a78e-325ca2b944b4', 'volume_name': 'volume-9218ff7c-da43-4165-a78e-325ca2b944b4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109afdb1-f7ca-40c4-afb5-21e09a1bd493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109afdb1-f7ca-40c4-afb5-21e09a1bd493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bb43bf-c97e-4621-8c78-fb13889f80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:17 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Volume 9218ff7c-da43-4165-a78e-325ca2b944b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9218ff7c-da43-4165-a78e-325ca2b944b4', 'volume_size': 1}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:17 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD" returned: 0 in 1.942s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:18 devstack sudo[112566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD
Jun 26 00:37:18 devstack sudo[112566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:19 devstack sudo[112566]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD" returned: 1 in 1.885s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:37:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:20 devstack sudo[112535]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199" returned: 0 in 6.778s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[6174d45e-8346-4fbd-aa26-8f72c71ccf46]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:20 devstack sudo[112571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:37:20 devstack sudo[112571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:21 devstack sudo[112571]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:37:21 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Converted 1024.00 MB image at 151.05 MB/s
Jun 26 00:37:21 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 is being set with open permissions: ugo+rw
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:21 devstack sudo[112576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199
Jun 26 00:37:21 devstack sudo[112576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:21 devstack sudo[112576]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199" returned: 0 in 0.677s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-d73a743a-7228-445e-9147-cbad075a2199" released by "_copy_volume_from_snapshot" :: held 10.770s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1-d73a743a-7228-445e-9147-cbad075a2199" released by "_create_volume_from_snapshot" :: held 10.850s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.934s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.250s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-712406605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9218ff7c-da43-4165-a78e-325ca2b944b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:17Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Creating volume 9218ff7c-da43-4165-a78e-325ca2b944b4 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:21 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:21 devstack sudo[112579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4 1073741824
Jun 26 00:37:21 devstack sudo[112579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76507f44-1e3b-4a3c-af35-ae01dbb65f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73a743a-7228-445e-9147-cbad075a2199', 'volume_size': 1, 'snapshot_id': '6e5e6be0-c988-4cc2-aac3-b63be0edcbe1'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33195b1-bdb3-4fe8-aa51-74f5b1724ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:22 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Volume volume-d73a743a-7228-445e-9147-cbad075a2199 (d73a743a-7228-445e-9147-cbad075a2199): created successfully
Jun 26 00:37:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33195b1-bdb3-4fe8-aa51-74f5b1724ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Flow 'volume_create_manager' (592f7f16-e4d9-448c-a50a-898828767882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-044de671-df1e-41f8-a499-f1fc719cc3ad tempest-SnapshotDependencyTests-1326524551 None] Created volume successfully.
Jun 26 00:37:22 devstack sudo[112579]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4 1073741824" returned: 0 in 0.917s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:22 devstack sudo[112584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4
Jun 26 00:37:22 devstack sudo[112584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-quobyte-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-quobyte-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Deleting offline snapshot 6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 of volume 8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] snapshot_file for this snap is: volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c9de2f-1092-4f6f-9ce1-c4c455f84be2]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:23 devstack sudo[112586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1
Jun 26 00:37:23 devstack sudo[112586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:23 devstack sudo[112584]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4" returned: 0 in 0.742s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34fc058-2bd5-4af6-b30a-e5f6de57fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617f0e1c7c3d41ae92b83004e742bc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:12Z,use_quota=True,user_id='398f720706244d428e8befb8c00147fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Creating volume c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:23 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bb43bf-c97e-4621-8c78-fb13889f80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9218ff7c-da43-4165-a78e-325ca2b944b4', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:23 devstack sudo[112589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 1073741824
Jun 26 00:37:23 devstack sudo[112589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde7d854-556f-4534-822f-f413dda47966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:23 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Volume volume-9218ff7c-da43-4165-a78e-325ca2b944b4 (9218ff7c-da43-4165-a78e-325ca2b944b4): created successfully
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde7d854-556f-4534-822f-f413dda47966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (eb87bffe-171d-4bc8-8523-609c0c4a6d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:23 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c56cbfe8-fb2e-498d-b6d0-9a1e95789a16 tempest-VolumesActionsTest-1327290416 None] Created volume successfully.
Jun 26 00:37:24 devstack sudo[112586]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" returned: 0 in 0.843s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad212a3-1594-418d-b4eb-0618e4d51a81]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:24 devstack sudo[112594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:37:24 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:24 devstack sudo[112589]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-9218ff7c-da43-4165-a78e-325ca2b944b4-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 1073741824" returned: 0 in 1.050s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-9218ff7c-da43-4165-a78e-325ca2b944b4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-quobyte-9218ff7c-da43-4165-a78e-325ca2b944b4" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-9218ff7c-da43-4165-a78e-325ca2b944b4" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:24 devstack sudo[112611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:24 devstack sudo[112611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbd2691-51e6-487e-bc0a-ddb953aa937a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:25 devstack sudo[112613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4
Jun 26 00:37:25 devstack sudo[112613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:25 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 0.965s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:25 devstack sudo[112618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1
Jun 26 00:37:25 devstack sudo[112618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:25 devstack sudo[112611]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 0 in 0.731s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Attempting download of f92c3c12-d8df-4308-a56f-124c85e03f1c ((None, [{'url': 'file:///opt/stack/data/glance/images/f92c3c12-d8df-4308-a56f-124c85e03f1c', 'metadata': {}}])) to volume c34fc058-2bd5-4af6-b30a-e5f6de57fa53. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159adad-1de6-4f38-8605-55761d575abf]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:25 devstack sudo[112621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7
Jun 26 00:37:25 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:25 devstack sudo[112613]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4" returned: 0 in 0.918s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:25 devstack sudo[112626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4
Jun 26 00:37:25 devstack sudo[112626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:26 devstack sudo[112618]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" returned: 0 in 0.947s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:26 devstack sudo[112631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1
Jun 26 00:37:26 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:26 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7" returned: 0 in 0.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:26 devstack sudo[112636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7
Jun 26 00:37:26 devstack sudo[112626]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:26 devstack sudo[112636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9218ff7c-da43-4165-a78e-325ca2b944b4" returned: 0 in 0.656s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-9218ff7c-da43-4165-a78e-325ca2b944b4" released by "delete_volume" :: held 1.616s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Created reservations ['49dac852-ea78-4735-ac0c-10a1fba1db9f', '44b215b9-d73b-42fc-b27b-56084c80d1cd', 'b78c8161-5cc6-43bf-8975-901fcda8850f', 'a8fba3b1-5332-4ba4-b452-464bd1cd64af'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:26 devstack sudo[112638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:26 devstack sudo[112638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:26 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f.6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" returned: 0 in 0.760s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1" released by "_delete_snapshot" :: held 3.628s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" released by "delete_snapshot" :: held 3.663s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Created reservations ['7d3a203f-ff6e-4702-aca8-1ac3c46a5608', 'f9b500f7-e0d0-4b73-846a-d2f101962a4f', 'b124226a-4603-4e6e-ab5e-29b793f158b8', '9eab4329-25bb-4a18-b6ec-103009c48fbe'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:27 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Delete snapshot completed successfully.
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f328311a-0b7e-4a18-947f-803662a5eadf tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-6e5e6be0-c988-4cc2-aac3-b63be0edcbe1-delete_snapshot" released by "delete_snapshot" :: held 3.910s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:27 devstack sudo[112636]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7" returned: 1 in 0.760s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f92c3c12-d8df-4308-a56f-124c85e03f1c_wp10y0h7' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c223b2-d5f4-4efa-a7d4-c3f7b8838b16]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:27 devstack sudo[112643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD
Jun 26 00:37:27 devstack sudo[112643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:27 devstack sudo[112638]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.649s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:27 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Deleted volume successfully.
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6eab3738-cd8e-4c84-b60a-5ea2896da170 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-9218ff7c-da43-4165-a78e-325ca2b944b4-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-8b3a1fdd-1233-487f-8e5d-e573a6ba427f-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-8b3a1fdd-1233-487f-8e5d-e573a6ba427f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-quobyte-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbf3047-ddd3-4aa6-86fc-3da53ca45c93]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (0e20647a-8bee-4d95-8439-43634df42cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f908dd5-2bc8-48b1-ac77-40b1430b80f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f908dd5-2bc8-48b1-ac77-40b1430b80f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538904447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ab31fb-4d8b-4a03-9697-7345dade4f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:28Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b108c84-a1b9-4d8f-b8c4-c17cc020f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:27 devstack sudo[112646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b108c84-a1b9-4d8f-b8c4-c17cc020f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:27 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a3bcf6-c0c6-4cd0-a9d2-4714b0af1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a3bcf6-c0c6-4cd0-a9d2-4714b0af1230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ab31fb-4d8b-4a03-9697-7345dade4f32', 'volume_name': 'volume-44ab31fb-4d8b-4a03-9697-7345dade4f32', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5aa2975-319a-4bfa-8753-726ae3ba9614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5aa2975-319a-4bfa-8753-726ae3ba9614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cf43cc-f01f-4729-ae49-1ece61b078f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:27 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Volume 44ab31fb-4d8b-4a03-9697-7345dade4f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ab31fb-4d8b-4a03-9697-7345dade4f32', 'volume_size': 1}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538904447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ab31fb-4d8b-4a03-9697-7345dade4f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:28Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Creating volume 44ab31fb-4d8b-4a03-9697-7345dade4f32 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:27 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:27 devstack sudo[112650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 1073741824
Jun 26 00:37:27 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:27 devstack sudo[112643]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:27 devstack sudo[112652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD
Jun 26 00:37:27 devstack sudo[112652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:28 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 0.791s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:28 devstack sudo[112660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f
Jun 26 00:37:28 devstack sudo[112660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:28 devstack sudo[112652]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] f92c3c12-d8df-4308-a56f-124c85e03f1c was raw, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:28 devstack sudo[112665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:28 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:28 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 1073741824" returned: 0 in 0.921s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:28 devstack sudo[112667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32
Jun 26 00:37:28 devstack sudo[112667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:29 devstack sudo[112660]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" returned: 0 in 0.762s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-8b3a1fdd-1233-487f-8e5d-e573a6ba427f" released by "delete_volume" :: held 1.657s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Created reservations ['b4c1d3f9-39b9-4530-8291-ae0b1b16f1e8', 'a79b722f-9ab3-4fa1-85f7-11bb6c482220', 'a2b44f8e-7db0-4d10-9ec7-91e1b04b3dfe', 'ba230952-1ac3-41c2-ba94-38904cbe66e9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:29 devstack sudo[112708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:29 devstack sudo[112708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:29 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 0 in 0.814s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f92c3c12-d8df-4308-a56f-124c85e03f1c_aifd7ackdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:37:29 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:29 devstack sudo[112710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 1G
Jun 26 00:37:29 devstack sudo[112710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:29 devstack sudo[112667]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32" returned: 0 in 0.750s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cf43cc-f01f-4729-ae49-1ece61b078f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ab31fb-4d8b-4a03-9697-7345dade4f32', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea54d3a-e329-46a7-bfd3-3db35c55b55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:29 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Volume volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 (44ab31fb-4d8b-4a03-9697-7345dade4f32): created successfully
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea54d3a-e329-46a7-bfd3-3db35c55b55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (0e20647a-8bee-4d95-8439-43634df42cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5bcd322c-0baa-475b-a606-464c0653f4bb tempest-VolumesActionsTest-1327290416 None] Created volume successfully.
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-d73a743a-7228-445e-9147-cbad075a2199-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-d73a743a-7228-445e-9147-cbad075a2199-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "cinder-quobyte-d73a743a-7228-445e-9147-cbad075a2199" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-d73a743a-7228-445e-9147-cbad075a2199" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-44ab31fb-4d8b-4a03-9697-7345dade4f32-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3d3673-b03c-4f0c-aa54-d1dd38f66e15]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-44ab31fb-4d8b-4a03-9697-7345dade4f32-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "cinder-quobyte-44ab31fb-4d8b-4a03-9697-7345dade4f32" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-44ab31fb-4d8b-4a03-9697-7345dade4f32" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc002aa8-13a1-4320-b4da-469685b253e4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:30 devstack sudo[112714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199
Jun 26 00:37:30 devstack sudo[112714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:30 devstack sudo[112715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32
Jun 26 00:37:30 devstack sudo[112715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:30 devstack sudo[112710]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 1G" returned: 0 in 0.946s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f8ae8-af12-4417-9a38-2e06401562ab]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:30 devstack sudo[112708]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.102s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Deleted volume successfully.
Jun 26 00:37:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-968356dd-06a4-4b11-80a7-80ef42bcdc76 tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-8b3a1fdd-1233-487f-8e5d-e573a6ba427f-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:30 devstack sudo[112722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:30 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:31 devstack sudo[112714]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199" returned: 0 in 1.177s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:31 devstack sudo[112729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199
Jun 26 00:37:31 devstack sudo[112729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:31 devstack sudo[112715]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32" returned: 0 in 1.287s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:31 devstack sudo[112734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32
Jun 26 00:37:31 devstack sudo[112734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:31 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 0 in 1.086s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:31 devstack sudo[112736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:31 devstack sudo[112736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:31 devstack sudo[112729]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d73a743a-7228-445e-9147-cbad075a2199" returned: 0 in 0.741s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-quobyte-d73a743a-7228-445e-9147-cbad075a2199" released by "delete_volume" :: held 1.996s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Created reservations ['59b4a344-7ce1-406b-bb0a-f47739260583', '6bec579a-0ed4-4cbb-93cf-15fec6e95b16', 'b1243d22-ae64-48e8-9482-917fbab02a06', 'cde86db8-447e-42ac-9cde-fe1d5008a9d1'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:32 devstack sudo[112740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:32 devstack sudo[112740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:32 devstack sudo[112734]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-44ab31fb-4d8b-4a03-9697-7345dade4f32" returned: 0 in 0.976s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-quobyte-44ab31fb-4d8b-4a03-9697-7345dade4f32" released by "delete_volume" :: held 2.332s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Created reservations ['4167b70e-fa4a-483e-a1e9-934091c076be', 'eb39c547-5b95-4b79-b262-7949fb2dae23', '9467a552-c613-4f65-94e9-b6e588982e5d', '53d1077e-15e2-44e8-a135-e7a369a04bcc'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:32 devstack sudo[112744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:32 devstack sudo[112744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:32 devstack sudo[112736]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 1 in 1.276s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Downloaded image f92c3c12-d8df-4308-a56f-124c85e03f1c ((None, [{'url': 'file:///opt/stack/data/glance/images/f92c3c12-d8df-4308-a56f-124c85e03f1c', 'metadata': {}}])) to volume c34fc058-2bd5-4af6-b30a-e5f6de57fa53 successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Temporary image f92c3c12-d8df-4308-a56f-124c85e03f1c for user 398f720706244d428e8befb8c00147fa is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Marking volume c34fc058-2bd5-4af6-b30a-e5f6de57fa53 as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Copying metadata from image f92c3c12-d8df-4308-a56f-124c85e03f1c to c34fc058-2bd5-4af6-b30a-e5f6de57fa53. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Creating volume glance metadata for volume c34fc058-2bd5-4af6-b30a-e5f6de57fa53 backed by image f92c3c12-d8df-4308-a56f-124c85e03f1c with: {'image_id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '690dee7b8dd241bdbc85c4fdbde1cb97', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600e5e40-eef0-4c2c-8b51-e431b19bb3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53', 'volume_size': 1, 'image_id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f92c3c12-d8df-4308-a56f-124c85e03f1c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '690dee7b8dd241bdbc85c4fdbde1cb97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '617f0e1c7c3d41ae92b83004e742bc29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7b5f344e6364954c4739cd74512f4c0b917bed4b45f4e629b817ee8f516903663a5d8dd38070549bc8c23086655af1bfcb2f2397518f7bfee596f8d1d6760d4c', 'id': 'f92c3c12-d8df-4308-a56f-124c85e03f1c', 'created_at': datetime.datetime(2026, 6, 25, 22, 37, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 37, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f92c3c12-d8df-4308-a56f-124c85e03f1c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459c07e00>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f49aca-c058-4515-ae6e-bfe0f53f690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:33 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Volume volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 (c34fc058-2bd5-4af6-b30a-e5f6de57fa53): created successfully
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f49aca-c058-4515-ae6e-bfe0f53f690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Flow 'volume_create_manager' (374f64ad-49b5-49ab-b7b3-b4494c760543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:33 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5aef6d4a-6fa7-4857-99e5-076a705ee51a tempest-VolumeImageDependencyTests-850977920 None] Created volume successfully.
Jun 26 00:37:33 devstack sudo[112740]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.024s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:33 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Deleted volume successfully.
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e6707ac-14b3-4057-a74d-6bbd271739ef tempest-SnapshotDependencyTests-1326524551 None] Lock "cinder-d73a743a-7228-445e-9147-cbad075a2199-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Acquiring lock "cinder-c34fc058-2bd5-4af6-b30a-e5f6de57fa53-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Lock "cinder-c34fc058-2bd5-4af6-b30a-e5f6de57fa53-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:33 devstack sudo[112744]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.169s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:33 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Deleted volume successfully.
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Acquiring lock "cinder-quobyte-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Lock "cinder-quobyte-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-279da12d-525c-4b99-b7e8-fa53dbfb8be7 tempest-VolumesActionsTest-1115159517 None] Lock "cinder-44ab31fb-4d8b-4a03-9697-7345dade4f32-delete_volume" released by "delete_volume" :: held 3.886s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9aa8a5-bb2f-4b29-889e-13376ed19cce]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:34 devstack sudo[112749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:34 devstack sudo[112749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (ebdba370-e9e5-402e-9650-cabe576a6d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1153c65-0f2e-43dd-b3cf-7b244ba53c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1153c65-0f2e-43dd-b3cf-7b244ba53c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1091609425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98516cb-04e8-46f5-b1a1-847f5303aee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:34Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d498bb-8c2e-4350-89e5-0be184718ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d498bb-8c2e-4350-89e5-0be184718ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8dc7c3-6db4-4503-8c19-a7d6a72b5a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8dc7c3-6db4-4503-8c19-a7d6a72b5a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98516cb-04e8-46f5-b1a1-847f5303aee1', 'volume_name': 'volume-e98516cb-04e8-46f5-b1a1-847f5303aee1', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2731b47-c343-4933-a071-5f70f388e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2731b47-c343-4933-a071-5f70f388e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239d6265-658a-4b73-aeaa-e4e49364f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:34 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Volume e98516cb-04e8-46f5-b1a1-847f5303aee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98516cb-04e8-46f5-b1a1-847f5303aee1', 'volume_size': 1}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1091609425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98516cb-04e8-46f5-b1a1-847f5303aee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a248fb876f841e7a07e1cdd28cccf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:34Z,use_quota=True,user_id='ff3275fa54cc41f09139113e5c495959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Creating volume e98516cb-04e8-46f5-b1a1-847f5303aee1 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:34 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:34 devstack sudo[112752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 1073741824
Jun 26 00:37:34 devstack sudo[112752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:34 devstack sudo[112749]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 0 in 1.078s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:35 devstack sudo[112756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:35 devstack sudo[112756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:35 devstack sudo[112752]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 1073741824" returned: 0 in 1.065s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:35 devstack sudo[112762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1
Jun 26 00:37:35 devstack sudo[112762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:35 devstack sudo[112756]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 1 in 0.962s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:37:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:35 devstack sudo[112768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53
Jun 26 00:37:35 devstack sudo[112768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:36 devstack sudo[112762]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1" returned: 0 in 0.781s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239d6265-658a-4b73-aeaa-e4e49364f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98516cb-04e8-46f5-b1a1-847f5303aee1', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1430e3-c3be-415d-8165-9237b212e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:36 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Volume volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 (e98516cb-04e8-46f5-b1a1-847f5303aee1): created successfully
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1430e3-c3be-415d-8165-9237b212e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Flow 'volume_create_manager' (ebdba370-e9e5-402e-9650-cabe576a6d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-397e7062-4106-443e-ba72-653357ffc6de tempest-VolumesActionsTest-1327290416 None] Created volume successfully.
Jun 26 00:37:36 devstack sudo[112768]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" returned: 0 in 0.784s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Lock "cinder-quobyte-c34fc058-2bd5-4af6-b30a-e5f6de57fa53" released by "delete_volume" :: held 2.924s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Created reservations ['b73d9d88-09da-44ab-b38e-4073dc00bcfd', '053bc194-54c4-4d7a-b66a-375ac95e266b', 'ae7b5247-8605-4a2b-8e97-f4d13958e1c5', 'b182dcaa-3ec3-427c-827e-80801d139b42'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:37 devstack sudo[112772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:37 devstack sudo[112772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:37 devstack sudo[112772]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.951s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:37 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Deleted volume successfully.
Jun 26 00:37:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4d5b12e1-719c-4c8b-976b-6acf8c45a78f tempest-VolumeImageDependencyTests-850977920 None] Lock "cinder-c34fc058-2bd5-4af6-b30a-e5f6de57fa53-delete_volume" released by "delete_volume" :: held 4.273s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "cinder-e98516cb-04e8-46f5-b1a1-847f5303aee1-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Lock "cinder-e98516cb-04e8-46f5-b1a1-847f5303aee1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "cinder-quobyte-e98516cb-04e8-46f5-b1a1-847f5303aee1" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Lock "cinder-quobyte-e98516cb-04e8-46f5-b1a1-847f5303aee1" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:38 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f32d0f-b066-405a-8fba-7ae1b0590135]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:38 devstack sudo[112776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1
Jun 26 00:37:38 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:39 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1" returned: 0 in 0.990s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:39 devstack sudo[112782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1
Jun 26 00:37:39 devstack sudo[112782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:40 devstack sudo[112782]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e98516cb-04e8-46f5-b1a1-847f5303aee1" returned: 0 in 0.726s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Lock "cinder-quobyte-e98516cb-04e8-46f5-b1a1-847f5303aee1" released by "delete_volume" :: held 1.772s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Created reservations ['5f837e16-5861-4fe4-9f7d-74b61d8fe6d7', '9b49e161-a91e-499f-9705-efe680e73810', '8601c553-055d-490c-8ef1-e7d4682be372', '9d2768d7-5049-45fb-9ee9-064a7efd90c8'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:40 devstack sudo[112786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:40 devstack sudo[112786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:40 devstack sudo[112786]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.668s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:41 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Deleted volume successfully.
Jun 26 00:37:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-475b77c1-1380-4073-8fae-e0cbacd1ae47 tempest-VolumesActionsTest-1327290416 None] Lock "cinder-e98516cb-04e8-46f5-b1a1-847f5303aee1-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=80,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=34 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:37:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-56bff2dc-acbf-4d80-931c-3dde6231e4da req-4e0f5442-df0e-4bfb-be62-b224ec2ecf99 tempest-TestMinimumBasicScenario-1193251744 None] Terminate volume connection completed successfully.
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-56bff2dc-acbf-4d80-931c-3dde6231e4da req-4e0f5442-df0e-4bfb-be62-b224ec2ecf99 tempest-TestMinimumBasicScenario-1193251744 None] Deleting attachment d9afd269-1bb9-4cd7-a0b3-6a216b30119d. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Flow 'volume_create_manager' (8d29e543-5800-43ac-9e5e-cd4eea31fe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49424c84-3592-4213-8b68-c3f06cdadaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49424c84-3592-4213-8b68-c3f06cdadaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1544069098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b14c24a-bad2-44a8-86c6-66f979569f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d20bbdacfc448cb334790dd094a8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:52Z,use_quota=True,user_id='38ff5bf9693e44ca8871e0ac2e9ec9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5801dea-081e-45f7-87fd-f38d46491c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5801dea-081e-45f7-87fd-f38d46491c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a94bc5e-a80e-4a03-900c-f820ffdf20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a94bc5e-a80e-4a03-900c-f820ffdf20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b14c24a-bad2-44a8-86c6-66f979569f3f', 'volume_name': 'volume-8b14c24a-bad2-44a8-86c6-66f979569f3f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d836b9-6fd1-49f8-919f-b05d1074b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d836b9-6fd1-49f8-919f-b05d1074b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d228c02f-7768-4e31-b333-0d45794ec154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:51 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Volume 8b14c24a-bad2-44a8-86c6-66f979569f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b14c24a-bad2-44a8-86c6-66f979569f3f', 'volume_size': 1}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1544069098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b14c24a-bad2-44a8-86c6-66f979569f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d20bbdacfc448cb334790dd094a8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:37:52Z,use_quota=True,user_id='38ff5bf9693e44ca8871e0ac2e9ec9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Creating volume 8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:37:51 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:37:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:51 devstack sudo[112808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f 1073741824
Jun 26 00:37:51 devstack sudo[112808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:52 devstack sudo[112808]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f 1073741824" returned: 0 in 0.894s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:52 devstack sudo[112815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f
Jun 26 00:37:52 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Acquiring lock "cinder-c4194794-7757-4013-b507-143fc239bd8b-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Lock "cinder-c4194794-7757-4013-b507-143fc239bd8b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Acquiring lock "cinder-quobyte-c4194794-7757-4013-b507-143fc239bd8b" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Lock "cinder-quobyte-c4194794-7757-4013-b507-143fc239bd8b" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501249e-d0e1-4e39-b905-a3326ccdb101]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:53 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f" returned: 0 in 0.704s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d228c02f-7768-4e31-b333-0d45794ec154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b14c24a-bad2-44a8-86c6-66f979569f3f', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe99ae64-4791-4ae8-b1f3-73ec2dc94955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:37:53 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Volume volume-8b14c24a-bad2-44a8-86c6-66f979569f3f (8b14c24a-bad2-44a8-86c6-66f979569f3f): created successfully
Jun 26 00:37:53 devstack sudo[112818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b
Jun 26 00:37:53 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe99ae64-4791-4ae8-b1f3-73ec2dc94955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:37:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Flow 'volume_create_manager' (8d29e543-5800-43ac-9e5e-cd4eea31fe28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:37:53 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f60965c4-4ccd-44be-acd5-6ea1fc86e837 tempest-VolumesDeleteCascade-872702019 None] Created volume successfully.
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Creating offline snapshot e7c4abf2-626e-4407-9c75-722c99892761 of volume 8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[76afbc93-956d-4dd5-853d-af4ad479d25e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:54 devstack sudo[112822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f
Jun 26 00:37:54 devstack sudo[112822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:54 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b" returned: 0 in 0.835s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:54 devstack sudo[112826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b
Jun 26 00:37:54 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:54 devstack sudo[112822]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f" returned: 0 in 0.795s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:54 devstack sudo[112832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 1G
Jun 26 00:37:54 devstack sudo[112832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:55 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c4194794-7757-4013-b507-143fc239bd8b" returned: 0 in 0.736s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Lock "cinder-quobyte-c4194794-7757-4013-b507-143fc239bd8b" released by "delete_volume" :: held 1.610s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Created reservations ['6066a9ae-c459-441c-bc8c-27656487db38', '6cbd7e3f-7dbe-482b-94a9-47cba6e784f0', '404dfd04-3365-4362-9b51-c625e61659b1', '9376420f-d330-40e3-99ec-08aa6543e921'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:55 devstack sudo[112836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:37:55 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:55 devstack sudo[112832]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 1G" returned: 0 in 0.950s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b14c24a-bad2-44a8-86c6-66f979569f3f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:55 devstack sudo[112842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b14c24a-bad2-44a8-86c6-66f979569f3f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:37:55 devstack sudo[112842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:55 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.728s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:37:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Deleted volume successfully.
Jun 26 00:37:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a99e7903-3a2a-406c-94a9-8937ad3bc40b tempest-TestMinimumBasicScenario-1193251744 None] Lock "cinder-c4194794-7757-4013-b507-143fc239bd8b-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:37:56 devstack sudo[112842]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b14c24a-bad2-44a8-86c6-66f979569f3f -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 0.745s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:56 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 is being set with open permissions: ugo+rw
Jun 26 00:37:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:56 devstack sudo[112847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:37:56 devstack sudo[112847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:57 devstack sudo[112847]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 1.014s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:57 devstack sudo[112921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info
Jun 26 00:37:57 devstack sudo[112921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:58 devstack sudo[112921]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info" returned: 0 in 0.900s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:58 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info is being set with open permissions: ugo+rw
Jun 26 00:37:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:37:58 devstack sudo[112948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info
Jun 26 00:37:58 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:37:59 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root
Jun 26 00:37:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.info" returned: 0 in 0.793s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:37:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.325s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:37:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9383ef79-ef48-4359-a13a-d94a024e20c3 tempest-VolumesDeleteCascade-872702019 None] Create snapshot completed successfully
Jun 26 00:37:59 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=93,cinder:INSERT=32,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Creating offline snapshot 9bdbea19-f693-43bb-b8bb-f64fe59af530 of volume 8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8369310-f535-4fb2-bc00-8ae18c69bb7f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:00 devstack sudo[112955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:38:00 devstack sudo[112955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:01 devstack sudo[112957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:38:01 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:01 devstack sudo[112955]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 0.819s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b14c24a-bad2-44a8-86c6-66f979569f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:01 devstack sudo[112962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 1G
Jun 26 00:38:01 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:01 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:38:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:38:02 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 1G" returned: 0 in 0.867s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:02 devstack sudo[112975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530
Jun 26 00:38:02 devstack sudo[112975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:03 devstack sudo[112975]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530" returned: 0 in 0.704s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:03 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 is being set with open permissions: ugo+rw
Jun 26 00:38:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:03 devstack sudo[112980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530
Jun 26 00:38:03 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:03 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530" returned: 0 in 0.655s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:03 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-17d86af5-d6f5-4579-b255-426aa7d144ec tempest-VolumesDeleteCascade-872702019 None] Create snapshot completed successfully
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-8b14c24a-bad2-44a8-86c6-66f979569f3f-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-8b14c24a-bad2-44a8-86c6-66f979569f3f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Performing cascade delete. {{(pid=94563) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-9bdbea19-f693-43bb-b8bb-f64fe59af530-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-9bdbea19-f693-43bb-b8bb-f64fe59af530-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-9bdbea19-f693-43bb-b8bb-f64fe59af530" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-9bdbea19-f693-43bb-b8bb-f64fe59af530" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Deleting offline snapshot 9bdbea19-f693-43bb-b8bb-f64fe59af530 of volume 8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] snapshot_file for this snap is: volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b76e66-b591-433b-ad6b-a8cf38f62e55]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:05 devstack sudo[112984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530
Jun 26 00:38:05 devstack sudo[112984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:05 devstack sudo[112984]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530" returned: 0 in 0.810s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b14c24a-bad2-44a8-86c6-66f979569f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[68899dcd-e78e-4738-843d-856957a7e9bc]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:05 devstack sudo[112990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:38:05 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:06 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 0.856s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b14c24a-bad2-44a8-86c6-66f979569f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:38:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:06 devstack sudo[112995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530
Jun 26 00:38:06 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:07 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530" returned: 0 in 0.874s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:07 devstack sudo[113003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530
Jun 26 00:38:07 devstack sudo[113003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:08 devstack sudo[113003]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.9bdbea19-f693-43bb-b8bb-f64fe59af530" returned: 0 in 0.682s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-9bdbea19-f693-43bb-b8bb-f64fe59af530" released by "_delete_snapshot" :: held 3.321s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" released by "delete_snapshot" :: held 3.343s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Created reservations ['ea0bcc95-128a-4c99-87ea-4790c5e5fe5a', 'e5574dff-7f02-4cda-b596-2c4b12f22bf3', 'f1d91ea0-3091-4a17-8fd3-cf50645f145a', 'adb922b4-3bf6-45f8-86ba-c7e1c25ffc3d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Delete snapshot completed successfully.
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-9bdbea19-f693-43bb-b8bb-f64fe59af530-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-e7c4abf2-626e-4407-9c75-722c99892761-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-e7c4abf2-626e-4407-9c75-722c99892761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-e7c4abf2-626e-4407-9c75-722c99892761" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-e7c4abf2-626e-4407-9c75-722c99892761" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Deleting offline snapshot e7c4abf2-626e-4407-9c75-722c99892761 of volume 8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] snapshot_file for this snap is: volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f50501-f883-4277-8168-18bc29d06da1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:08 devstack sudo[113006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:38:08 devstack sudo[113006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:09 devstack sudo[113006]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 0.821s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b14c24a-bad2-44a8-86c6-66f979569f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:38:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ce5e8-ac08-4d17-a48e-73bacba1ed85]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:09 devstack sudo[113012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f
Jun 26 00:38:09 devstack sudo[113012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:10 devstack sudo[113012]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f" returned: 0 in 0.910s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:10 devstack sudo[113017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:38:10 devstack sudo[113017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:11 devstack sudo[113017]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 0.759s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:11 devstack sudo[113023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761
Jun 26 00:38:11 devstack sudo[113023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:11 devstack sudo[113023]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f.e7c4abf2-626e-4407-9c75-722c99892761" returned: 0 in 0.728s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-e7c4abf2-626e-4407-9c75-722c99892761" released by "_delete_snapshot" :: held 3.339s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" released by "delete_snapshot" :: held 3.367s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:11 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Created reservations ['c5d5f3c4-be13-4d80-99b2-178a7f9df359', '6fc4fb7b-691c-4715-84f1-32176cb13616', '5fa64e40-4052-4c68-84f4-86f778d4cf2e', '7922f194-cf0a-477d-b574-c9077beda347'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Delete snapshot completed successfully.
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-e7c4abf2-626e-4407-9c75-722c99892761-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Snapshots deleted, issuing volume delete {{(pid=94563) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2402df-8db0-4832-87c1-881b5511c753]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:12 devstack sudo[113026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f
Jun 26 00:38:12 devstack sudo[113026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:12 devstack sudo[113026]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f" returned: 0 in 0.843s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:12 devstack sudo[113031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f
Jun 26 00:38:12 devstack sudo[113031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:13 devstack sudo[113031]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8b14c24a-bad2-44a8-86c6-66f979569f3f" returned: 0 in 0.697s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-8b14c24a-bad2-44a8-86c6-66f979569f3f" released by "delete_volume" :: held 1.607s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Created reservations ['acdd1fb7-2292-4bee-9925-16541626db8b', '33039495-1dfc-46e1-bd4c-1ad72e366bc7', '75447420-d616-4720-8120-246f9a63a553', 'b53fb4e5-5aae-4901-924a-6b6ab23ab9d5'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:13 devstack sudo[113034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:38:13 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:14 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.668s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:14 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:38:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Deleted volume successfully.
Jun 26 00:38:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-70f2a023-c051-4209-9b38-f2d9c60c1488 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-8b14c24a-bad2-44a8-86c6-66f979569f3f-delete_volume" released by "delete_volume" :: held 9.617s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Flow 'volume_create_manager' (a9f6c7de-260c-4244-bdef-d2d99602596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662e65d1-9579-4302-9b6d-de85a02d21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662e65d1-9579-4302-9b6d-de85a02d21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-296067007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ef4e68-ef26-49ef-8c19-a90c3f7f4856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d20bbdacfc448cb334790dd094a8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:15Z,use_quota=True,user_id='38ff5bf9693e44ca8871e0ac2e9ec9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455630f0-8201-412f-aa26-9b23e13c0556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455630f0-8201-412f-aa26-9b23e13c0556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf648f-de34-49d5-a5a4-c16881430958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf648f-de34-49d5-a5a4-c16881430958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ef4e68-ef26-49ef-8c19-a90c3f7f4856', 'volume_name': 'volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b254dbe-660c-47c2-a191-eef743c34e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b254dbe-660c-47c2-a191-eef743c34e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32da37f-8802-49c9-bcfc-b175479d27b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:15 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Volume 38ef4e68-ef26-49ef-8c19-a90c3f7f4856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856', 'volume_size': 1}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-296067007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ef4e68-ef26-49ef-8c19-a90c3f7f4856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d20bbdacfc448cb334790dd094a8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:15Z,use_quota=True,user_id='38ff5bf9693e44ca8871e0ac2e9ec9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Creating volume 38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:38:15 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:38:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:15 devstack sudo[113038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 1073741824
Jun 26 00:38:15 devstack sudo[113038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:16 devstack sudo[113038]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 1073741824" returned: 0 in 0.929s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:16 devstack sudo[113044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:16 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:17 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.672s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32da37f-8802-49c9-bcfc-b175479d27b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8882fdc2-784c-4d67-b8f0-821ffa8b1d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:17 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Volume volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 (38ef4e68-ef26-49ef-8c19-a90c3f7f4856): created successfully
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8882fdc2-784c-4d67-b8f0-821ffa8b1d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Flow 'volume_create_manager' (a9f6c7de-260c-4244-bdef-d2d99602596d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-9df2572d-9c3a-458b-9910-1562c6347e47 tempest-VolumesDeleteCascade-872702019 None] Created volume successfully.
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Creating offline snapshot 71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 of volume 38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9d3f8-82d8-49bf-9f6c-39140fefd07d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:17 devstack sudo[113047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:17 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:18 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.807s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:18 devstack sudo[113052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 1G
Jun 26 00:38:18 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:19 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 1G" returned: 0 in 0.925s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:19 devstack sudo[113058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6
Jun 26 00:38:19 devstack sudo[113058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:20 devstack sudo[113058]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" returned: 0 in 0.751s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:20 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 is being set with open permissions: ugo+rw
Jun 26 00:38:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:20 devstack sudo[113063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6
Jun 26 00:38:20 devstack sudo[113063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:20 devstack sudo[113063]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" returned: 0 in 0.724s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:20 devstack sudo[113066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info
Jun 26 00:38:20 devstack sudo[113066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:21 devstack sudo[113066]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info" returned: 0 in 0.686s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:21 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info is being set with open permissions: ugo+rw
Jun 26 00:38:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:21 devstack sudo[113069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info
Jun 26 00:38:21 devstack sudo[113069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:22 devstack sudo[113069]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.info" returned: 0 in 0.659s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.651s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7292a895-6980-4d4a-8303-35a9d10ca302 tempest-VolumesDeleteCascade-872702019 None] Create snapshot completed successfully
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Flow 'volume_create_manager' (d3439c95-a0d8-45d5-9021-f8a565ab9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc8c86a-c8dd-49f0-968f-87e5b694e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc8c86a-c8dd-49f0-968f-87e5b694e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1845196961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fcfa72-8336-41fa-9930-fa1f4b56e5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d20bbdacfc448cb334790dd094a8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:23Z,use_quota=True,user_id='38ff5bf9693e44ca8871e0ac2e9ec9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fb3436-ff47-460d-842a-76e629996a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fb3436-ff47-460d-842a-76e629996a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb445a-4931-4c9d-b03c-c6be53cc96d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb445a-4931-4c9d-b03c-c6be53cc96d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13fcfa72-8336-41fa-9930-fa1f4b56e5a2', 'volume_name': 'volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2', 'volume_size': 1, 'snapshot_id': '71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7080dd2-0676-4f7f-8d9c-a0a7a3004624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7080dd2-0676-4f7f-8d9c-a0a7a3004624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45173e7-19aa-4578-b615-108fd5e4b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:23 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Volume 13fcfa72-8336-41fa-9930-fa1f4b56e5a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2', 'volume_size': 1, 'snapshot_id': '71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6'}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Creating volume 13fcfa72-8336-41fa-9930-fa1f4b56e5a2 from snapshot 71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] snapshot: 71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6, volume: 13fcfa72-8336-41fa-9930-fa1f4b56e5a2,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[65817f18-d9e5-4669-837c-d55e3ecd913e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:23 devstack sudo[113072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6
Jun 26 00:38:23 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:24 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" returned: 0 in 0.805s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:38:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:38:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:38:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[952e3b4b-214f-4a2a-990f-1f39096c3d0f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:24 devstack sudo[113078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:24 devstack sudo[113078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:25 devstack sudo[113078]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.802s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:25 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:38:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:25 devstack sudo[113083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2
Jun 26 00:38:25 devstack sudo[113083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:30 devstack sudo[113083]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" returned: 0 in 5.474s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7ffbf-7a5f-4eaa-a455-9c330603d204]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:30 devstack sudo[113132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:30 devstack sudo[113132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:31 devstack sudo[113132]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.941s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:31 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:38:31 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Converted 1024.00 MB image at 187.00 MB/s
Jun 26 00:38:31 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 is being set with open permissions: ugo+rw
Jun 26 00:38:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:31 devstack sudo[113137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2
Jun 26 00:38:31 devstack sudo[113137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:32 devstack sudo[113137]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" returned: 0 in 0.619s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" released by "_copy_volume_from_snapshot" :: held 8.820s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" released by "_create_volume_from_snapshot" :: held 8.855s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.870s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45173e7-19aa-4578-b615-108fd5e4b43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2', 'volume_size': 1, 'snapshot_id': '71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2cfa8a-c1fd-4788-985e-f40687e809d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:32 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Volume volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 (13fcfa72-8336-41fa-9930-fa1f4b56e5a2): created successfully
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2cfa8a-c1fd-4788-985e-f40687e809d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Flow 'volume_create_manager' (d3439c95-a0d8-45d5-9021-f8a565ab9b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5e9585b2-ed18-45a5-bb90-38ca12012001 tempest-VolumesDeleteCascade-872702019 None] Created volume successfully.
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-38ef4e68-ef26-49ef-8c19-a90c3f7f4856-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-38ef4e68-ef26-49ef-8c19-a90c3f7f4856-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Performing cascade delete. {{(pid=94563) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Deleting offline snapshot 71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 of volume 38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] snapshot_file for this snap is: volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a0c07f-04ad-4909-9578-6e94009f15d1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:33 devstack sudo[113140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6
Jun 26 00:38:33 devstack sudo[113140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:34 devstack sudo[113140]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" returned: 0 in 0.808s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:38:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f00a0-5980-474e-843f-21ef2f47eb6d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:34 devstack sudo[113146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:34 devstack sudo[113146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:35 devstack sudo[113146]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.849s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:35 devstack sudo[113151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6
Jun 26 00:38:35 devstack sudo[113151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:36 devstack sudo[113151]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" returned: 0 in 0.741s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:36 devstack sudo[113156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6
Jun 26 00:38:36 devstack sudo[113156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:36 devstack sudo[113156]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856.71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" returned: 0 in 0.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6" released by "_delete_snapshot" :: held 3.211s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" released by "delete_snapshot" :: held 3.239s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Created reservations ['106b0382-e9b0-44be-91ce-2de49ac01f7e', 'e0a5313d-2662-4ba8-a447-6434ff42a306', 'ee566c6c-281a-4cb7-96c9-ec4bb23b09d3', 'a5940732-6f4f-40c3-921f-6fb92702dc04'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Delete snapshot completed successfully.
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-71b0f99a-0bd8-4e8c-b1c8-0eaa18dd37d6-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Snapshots deleted, issuing volume delete {{(pid=94563) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[becee3a1-0d31-4984-b4e1-fb1e91f96683]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:37 devstack sudo[113159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:37 devstack sudo[113159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:37 devstack sudo[113159]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.849s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:38 devstack sudo[113164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856
Jun 26 00:38:38 devstack sudo[113164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:38 devstack sudo[113164]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-38ef4e68-ef26-49ef-8c19-a90c3f7f4856" released by "delete_volume" :: held 1.656s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Created reservations ['4e133ced-7a62-4f99-85a2-21246d374fd4', 'eff56dae-d9ad-4c0e-b442-d7d70ce890d3', '6de8b128-8267-425c-8393-5f4cc270f0ed', 'c060821b-706e-46a8-b0cb-9dc555951661'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:38 devstack sudo[113167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:38:38 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-13fcfa72-8336-41fa-9930-fa1f4b56e5a2-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-13fcfa72-8336-41fa-9930-fa1f4b56e5a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "cinder-quobyte-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f63e7e-3a55-40ec-a422-1e5054ee7f3e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:39 devstack sudo[113170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2
Jun 26 00:38:39 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:39 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.761s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:38:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Deleted volume successfully.
Jun 26 00:38:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0c22ef4a-3b63-4f59-830c-7783e8fda2eb tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-38ef4e68-ef26-49ef-8c19-a90c3f7f4856-delete_volume" released by "delete_volume" :: held 6.090s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:40 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" returned: 0 in 0.807s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:40 devstack sudo[113176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2
Jun 26 00:38:40 devstack sudo[113176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:40 devstack sudo[113176]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" returned: 0 in 0.700s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-quobyte-13fcfa72-8336-41fa-9930-fa1f4b56e5a2" released by "delete_volume" :: held 1.600s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Created reservations ['c35f3b89-eea5-4481-a48d-bfdada62bd14', '94206dce-b0b7-454d-9f56-4ef2a99ae10b', '6e107e15-c173-4b25-b272-7aa53ea32736', '60f6f1dd-ea7c-441d-bd81-15f25e309da6'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:41 devstack sudo[113179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:38:41 devstack sudo[113179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:41 devstack sudo[113179]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.761s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:38:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Deleted volume successfully.
Jun 26 00:38:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b590c3d3-3950-4db0-a4fe-7f4dd6b8936c tempest-VolumesDeleteCascade-872702019 None] Lock "cinder-13fcfa72-8336-41fa-9930-fa1f4b56e5a2-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Flow 'volume_create_manager' (ee7e60d3-bdec-4040-8efc-5caf99a50c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a953e5f4-b7e9-461d-a8bc-d6567235fda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a953e5f4-b7e9-461d-a8bc-d6567235fda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-919045102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1900c36-6579-48a2-a1b6-534d40ad7aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9032999f4d0242c9b86c53f1ecebf209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:45Z,use_quota=True,user_id='6eca7ebf18f94304ae191b90dd41c87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4e5c4c-81a0-45ec-abb3-0d4f44a36f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4e5c4c-81a0-45ec-abb3-0d4f44a36f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5351fbd-2e42-41cc-9a6e-d89ad3875f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5351fbd-2e42-41cc-9a6e-d89ad3875f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1900c36-6579-48a2-a1b6-534d40ad7aba', 'volume_name': 'volume-e1900c36-6579-48a2-a1b6-534d40ad7aba', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf47b5a4-cef9-478a-bbcb-27bef6abe859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf47b5a4-cef9-478a-bbcb-27bef6abe859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bb88b4-ab0c-44b3-a245-e5cf899ecfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:44 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Volume e1900c36-6579-48a2-a1b6-534d40ad7aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1900c36-6579-48a2-a1b6-534d40ad7aba', 'volume_size': 1}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-919045102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1900c36-6579-48a2-a1b6-534d40ad7aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9032999f4d0242c9b86c53f1ecebf209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:45Z,use_quota=True,user_id='6eca7ebf18f94304ae191b90dd41c87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Creating volume e1900c36-6579-48a2-a1b6-534d40ad7aba {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:38:44 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:38:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:44 devstack sudo[113186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba 1073741824
Jun 26 00:38:44 devstack sudo[113186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:45 devstack sudo[113186]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba 1073741824" returned: 0 in 0.820s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:45 devstack sudo[113192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba
Jun 26 00:38:45 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:46 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba" returned: 0 in 0.669s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bb88b4-ab0c-44b3-a245-e5cf899ecfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1900c36-6579-48a2-a1b6-534d40ad7aba', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a944f7a-ad61-42c6-8144-e7755aedeff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:46 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Volume volume-e1900c36-6579-48a2-a1b6-534d40ad7aba (e1900c36-6579-48a2-a1b6-534d40ad7aba): created successfully
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a944f7a-ad61-42c6-8144-e7755aedeff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:46 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Flow 'volume_create_manager' (ee7e60d3-bdec-4040-8efc-5caf99a50c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0d186cbb-8b32-4c91-a5c3-1bd11d6249a3 tempest-VolumesMetadataTest-993299706 None] Created volume successfully.
Jun 26 00:38:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Acquiring lock "cinder-e1900c36-6579-48a2-a1b6-534d40ad7aba-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Lock "cinder-e1900c36-6579-48a2-a1b6-534d40ad7aba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Acquiring lock "cinder-quobyte-e1900c36-6579-48a2-a1b6-534d40ad7aba" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:38:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Lock "cinder-quobyte-e1900c36-6579-48a2-a1b6-534d40ad7aba" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:38:47 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[16de3179-6fa2-4f80-85a5-a839a0918791]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:47 devstack sudo[113195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba
Jun 26 00:38:47 devstack sudo[113195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:48 devstack sudo[113195]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba" returned: 0 in 0.878s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:48 devstack sudo[113208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba
Jun 26 00:38:48 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:49 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e1900c36-6579-48a2-a1b6-534d40ad7aba" returned: 0 in 0.690s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Lock "cinder-quobyte-e1900c36-6579-48a2-a1b6-534d40ad7aba" released by "delete_volume" :: held 1.610s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Created reservations ['cc5386af-3879-4259-8815-c1ec6ece53fb', 'd14e0102-adbb-4db9-811b-95f9fd4b5737', 'd6fd5a7b-2521-4d80-b085-104d6a4f6afe', 'bae776c8-d503-4ed8-a611-ace3321015a0'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:49 devstack sudo[113219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:38:49 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:49 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.644s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:38:49 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Deleted volume successfully.
Jun 26 00:38:49 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05847e1b-321a-4950-8c1f-e125dcd6bec8 tempest-VolumesMetadataTest-993299706 None] Lock "cinder-e1900c36-6579-48a2-a1b6-534d40ad7aba-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Flow 'volume_create_manager' (867fcfff-1505-4cb5-86cf-4044055654d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b29658-b973-4e97-816a-3fb2551be074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b29658-b973-4e97-816a-3fb2551be074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-901841508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a332555-f806-4911-a05c-6cc73bea5dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68116d15c9d24eeabecdc219cea819e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:52Z,use_quota=True,user_id='7681d5c716bc4357b33ebdf7625f5475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a03c991-1005-4469-8bf6-dfdb8db1d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a03c991-1005-4469-8bf6-dfdb8db1d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5031816-2a5f-422b-a43d-5c772fdb8ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5031816-2a5f-422b-a43d-5c772fdb8ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a332555-f806-4911-a05c-6cc73bea5dfc', 'volume_name': 'volume-9a332555-f806-4911-a05c-6cc73bea5dfc', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a760a320-2eb9-48c4-91e8-63888aa77b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a760a320-2eb9-48c4-91e8-63888aa77b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e063cdbc-6292-4755-bffd-e14835760e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:52 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Volume 9a332555-f806-4911-a05c-6cc73bea5dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a332555-f806-4911-a05c-6cc73bea5dfc', 'volume_size': 1}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-901841508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a332555-f806-4911-a05c-6cc73bea5dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68116d15c9d24eeabecdc219cea819e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:52Z,use_quota=True,user_id='7681d5c716bc4357b33ebdf7625f5475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Creating volume 9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:38:52 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:38:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:52 devstack sudo[113227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc 1073741824
Jun 26 00:38:52 devstack sudo[113227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:53 devstack sudo[113227]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc 1073741824" returned: 0 in 0.819s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:53 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=65,cinder:UPDATE=68,cinder:DELETE=3,cinder:INSERT=14 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:38:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:53 devstack sudo[113247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:38:53 devstack sudo[113247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:54 devstack sudo[113247]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 1.001s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e063cdbc-6292-4755-bffd-e14835760e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a332555-f806-4911-a05c-6cc73bea5dfc', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11e98c0-21aa-4500-b832-d98c6bd4b4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:54 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Volume volume-9a332555-f806-4911-a05c-6cc73bea5dfc (9a332555-f806-4911-a05c-6cc73bea5dfc): created successfully
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11e98c0-21aa-4500-b832-d98c6bd4b4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Flow 'volume_create_manager' (867fcfff-1505-4cb5-86cf-4044055654d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:54 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-70465ef2-8bb6-4ed6-a3eb-5abbf9dc2518 tempest-VolumesCloneTest-746443660 None] Created volume successfully.
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Flow 'volume_create_manager' (90d509e0-f6cd-4558-a9bc-c8e70943841c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedc92cc-04cb-427a-844f-c097be7afa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedc92cc-04cb-427a-844f-c097be7afa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1728547403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119e397-2960-49f5-bf22-04823dd79f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68116d15c9d24eeabecdc219cea819e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:38:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=9a332555-f806-4911-a05c-6cc73bea5dfc,status='creating',terminated_at=None,updated_at=2026-06-25T22:38:56Z,use_quota=True,user_id='7681d5c716bc4357b33ebdf7625f5475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10efe115-5991-4013-a9f5-c38db56a8325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10efe115-5991-4013-a9f5-c38db56a8325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cdb7e1-39a1-4735-a390-6d2c4c345205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cdb7e1-39a1-4735-a390-6d2c4c345205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e119e397-2960-49f5-bf22-04823dd79f1c', 'volume_name': 'volume-e119e397-2960-49f5-bf22-04823dd79f1c', 'volume_size': 2, 'source_volid': '9a332555-f806-4911-a05c-6cc73bea5dfc', 'source_volstatus': 'available'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2d7bb-a9db-44dd-a20a-23c9cded8f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2d7bb-a9db-44dd-a20a-23c9cded8f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34685f7d-6229-43ec-8f98-44a087255f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:38:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Volume e119e397-2960-49f5-bf22-04823dd79f1c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e119e397-2960-49f5-bf22-04823dd79f1c', 'volume_size': 2, 'source_volid': '9a332555-f806-4911-a05c-6cc73bea5dfc', 'source_volstatus': 'available'}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:38:56 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Cloning volume 9a332555-f806-4911-a05c-6cc73bea5dfc to volume e119e397-2960-49f5-bf22-04823dd79f1c
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Creating offline snapshot 5904d3c6-af42-467a-82d9-552572d39298 of volume 9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59262f-e64c-4ffc-a36b-caa5443ad94d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:38:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:56 devstack sudo[113320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:38:56 devstack sudo[113320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:57 devstack sudo[113320]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 0.867s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:57 devstack sudo[113327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 1G
Jun 26 00:38:57 devstack sudo[113327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:58 devstack sudo[113327]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 1G" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a332555-f806-4911-a05c-6cc73bea5dfc -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:58 devstack sudo[113341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a332555-f806-4911-a05c-6cc73bea5dfc -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298
Jun 26 00:38:58 devstack sudo[113341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:58 devstack sudo[113341]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a332555-f806-4911-a05c-6cc73bea5dfc -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298" returned: 0 in 0.731s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:58 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 is being set with open permissions: ugo+rw
Jun 26 00:38:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:58 devstack sudo[113346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298
Jun 26 00:38:58 devstack sudo[113346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:38:59 devstack sudo[113346]: pam_unix(sudo:session): session closed for user root
Jun 26 00:38:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298" returned: 0 in 0.698s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:38:59 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=69,cinder:SELECT=49,cinder:DELETE=8,cinder:INSERT=20 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:38:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:38:59 devstack sudo[113349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info
Jun 26 00:38:59 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:00 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info" returned: 0 in 0.695s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:00 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info is being set with open permissions: ugo+rw
Jun 26 00:39:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:00 devstack sudo[113352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info
Jun 26 00:39:00 devstack sudo[113352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:00 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:39:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:01 devstack sudo[113352]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.info" returned: 0 in 0.651s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:01 devstack sudo[113355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:39:01 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Acquiring lock "cinder-quobyte-e119e397-2960-49f5-bf22-04823dd79f1c" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-e119e397-2960-49f5-bf22-04823dd79f1c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] snapshot: 5904d3c6-af42-467a-82d9-552572d39298, volume: e119e397-2960-49f5-bf22-04823dd79f1c,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978b11d-21b2-4f75-b7e7-633af7949c6c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:01 devstack sudo[113357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298
Jun 26 00:39:01 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:01 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.679s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:39:01 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298" returned: 0 in 0.812s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a332555-f806-4911-a05c-6cc73bea5dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d31d53-2436-46e6-930a-8d9b4ff888e3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:02 devstack sudo[113363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:39:02 devstack sudo[113363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:02 devstack sudo[113363]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 0.775s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:02 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:39:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:02 devstack sudo[113374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c
Jun 26 00:39:02 devstack sudo[113374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:07 devstack sudo[113374]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c" returned: 0 in 5.071s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c2180c-7716-42d9-a779-4fc5e5c0ffde]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:07 devstack sudo[113388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:39:07 devstack sudo[113388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:08 devstack sudo[113388]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 0.909s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:08 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:39:08 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Converted 1024.00 MB image at 201.87 MB/s
Jun 26 00:39:08 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c is being set with open permissions: ugo+rw
Jun 26 00:39:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:08 devstack sudo[113411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c
Jun 26 00:39:08 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:09 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c" returned: 0 in 0.603s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-e119e397-2960-49f5-bf22-04823dd79f1c" released by "_copy_volume_from_snapshot" :: held 8.250s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Acquiring lock "cinder-quobyte-5904d3c6-af42-467a-82d9-552572d39298" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-5904d3c6-af42-467a-82d9-552572d39298" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Deleting offline snapshot 5904d3c6-af42-467a-82d9-552572d39298 of volume 9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] snapshot_file for this snap is: volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[df31fd37-a90a-46fb-a9b9-70e73ca6a89b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:09 devstack sudo[113414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298
Jun 26 00:39:09 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:10 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298" returned: 0 in 0.763s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a332555-f806-4911-a05c-6cc73bea5dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:39:10 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb1fd2b-2548-4a91-9a84-59dd5b3fb7e4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:10 devstack sudo[113419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:39:10 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:10 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 0.784s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:10 devstack sudo[113424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298
Jun 26 00:39:10 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:11 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298" returned: 0 in 0.777s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:11 devstack sudo[113429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298
Jun 26 00:39:11 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:12 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc.5904d3c6-af42-467a-82d9-552572d39298" returned: 0 in 0.622s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-5904d3c6-af42-467a-82d9-552572d39298" released by "_delete_snapshot" :: held 3.051s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.997s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34685f7d-6229-43ec-8f98-44a087255f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e119e397-2960-49f5-bf22-04823dd79f1c', 'volume_size': 2, 'source_volid': '9a332555-f806-4911-a05c-6cc73bea5dfc', 'source_volstatus': 'available'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f82471a-4a90-4a81-9cc6-6542165b1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:12 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Volume volume-e119e397-2960-49f5-bf22-04823dd79f1c (e119e397-2960-49f5-bf22-04823dd79f1c): created successfully
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f82471a-4a90-4a81-9cc6-6542165b1abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Flow 'volume_create_manager' (90d509e0-f6cd-4558-a9bc-c8e70943841c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8f16d336-691a-456a-8171-bb6b82e22e52 tempest-VolumesCloneTest-746443660 None] Created volume successfully.
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Acquiring lock "cinder-e119e397-2960-49f5-bf22-04823dd79f1c-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Lock "cinder-e119e397-2960-49f5-bf22-04823dd79f1c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Acquiring lock "cinder-quobyte-e119e397-2960-49f5-bf22-04823dd79f1c" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-e119e397-2960-49f5-bf22-04823dd79f1c" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e94ce0-1f47-4a8b-883c-ef74aea15db8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:12 devstack sudo[113432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c
Jun 26 00:39:12 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:13 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c" returned: 0 in 0.753s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:13 devstack sudo[113437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c
Jun 26 00:39:13 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:14 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-e119e397-2960-49f5-bf22-04823dd79f1c" returned: 0 in 0.632s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-e119e397-2960-49f5-bf22-04823dd79f1c" released by "delete_volume" :: held 1.426s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Created reservations ['69dacf10-5d49-42b3-ab16-23153082bfd3', '39daa9d2-60f2-4d21-8e9a-0462d3e1e23d', '18a277c0-d39f-451b-a7ab-b45e843fcea2', '8708fdf6-21db-44a7-9c1a-9097902110fc'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:14 devstack sudo[113441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:39:14 devstack sudo[113441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:15 devstack sudo[113441]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.658s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:39:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Deleted volume successfully.
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Acquiring lock "cinder-9a332555-f806-4911-a05c-6cc73bea5dfc-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddf0bbb5-94a5-490d-89c4-4ae50a04b3cc tempest-VolumesCloneTest-746443660 None] Lock "cinder-e119e397-2960-49f5-bf22-04823dd79f1c-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Lock "cinder-9a332555-f806-4911-a05c-6cc73bea5dfc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Acquiring lock "cinder-quobyte-9a332555-f806-4911-a05c-6cc73bea5dfc" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-9a332555-f806-4911-a05c-6cc73bea5dfc" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[451ce9d2-2d75-46a6-a1bb-a6bcab10e4ae]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:15 devstack sudo[113444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:39:15 devstack sudo[113444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:15 devstack sudo[113444]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 0.754s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:15 devstack sudo[113449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc
Jun 26 00:39:15 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:16 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9a332555-f806-4911-a05c-6cc73bea5dfc" returned: 0 in 0.649s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Lock "cinder-quobyte-9a332555-f806-4911-a05c-6cc73bea5dfc" released by "delete_volume" :: held 1.460s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Created reservations ['3522611d-3eaa-4337-bd7c-47766bfbce72', '699c36a8-ba67-45a2-880b-9ffc7060a1bf', '75964536-13d4-4cdb-a410-37d60a02363f', 'b688871d-c3c1-4980-aa0f-da526d99210b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:16 devstack sudo[113452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:39:16 devstack sudo[113452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:17 devstack sudo[113452]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.679s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:17 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:39:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Deleted volume successfully.
Jun 26 00:39:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f46ac04c-e57d-4c33-9c9c-c1c4494d3d7a tempest-VolumesCloneTest-746443660 None] Lock "cinder-9a332555-f806-4911-a05c-6cc73bea5dfc-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:20 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:39:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Flow 'volume_create_manager' (3378cef6-4032-45dd-999f-80ad9aa522dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16b6fa1-530a-4a03-b201-00f06b6caea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:20 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16b6fa1-530a-4a03-b201-00f06b6caea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-911360896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48435aaf-ae3a-4c42-be79-391d62ecf9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fead0bfeb1a343bab6737d65cf690d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:39:21Z,use_quota=True,user_id='8c31ad5dc5634e3f8602091afe6472e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b9474e-4864-42bf-8837-08213bb5ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b9474e-4864-42bf-8837-08213bb5ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13353b0-9948-46d4-ab1c-93067ca763b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13353b0-9948-46d4-ab1c-93067ca763b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48435aaf-ae3a-4c42-be79-391d62ecf9ee', 'volume_name': 'volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3057e9f-4533-405e-a9e7-24e5cdfcec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3057e9f-4533-405e-a9e7-24e5cdfcec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5180623-a87f-4f0b-b954-212d6fe07f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:21 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Volume 48435aaf-ae3a-4c42-be79-391d62ecf9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee', 'volume_size': 1}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-911360896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48435aaf-ae3a-4c42-be79-391d62ecf9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fead0bfeb1a343bab6737d65cf690d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:39:21Z,use_quota=True,user_id='8c31ad5dc5634e3f8602091afe6472e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Creating volume 48435aaf-ae3a-4c42-be79-391d62ecf9ee {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:39:21 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:21 devstack sudo[113458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee 1073741824
Jun 26 00:39:21 devstack sudo[113458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:21 devstack sudo[113458]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee 1073741824" returned: 0 in 0.856s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:21 devstack sudo[113464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee
Jun 26 00:39:21 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Flow 'volume_create_manager' (4413cc79-da46-46c4-9c7d-afb112c007d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:22 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e768b29-521c-475c-ae00-a6293fb4471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee" returned: 0 in 0.678s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e768b29-521c-475c-ae00-a6293fb4471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1138324224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6358eb29-139b-41de-88ce-7edb28dbfdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4584ecaa5a7444e9a2570b18e4f2d7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:39:23Z,use_quota=True,user_id='4f9e6060854d43128095637561462e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea74699a-345d-4586-bab5-4d4b68c85534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea74699a-345d-4586-bab5-4d4b68c85534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4a471a-68db-431d-8b4a-41663181b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4a471a-68db-431d-8b4a-41663181b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6358eb29-139b-41de-88ce-7edb28dbfdf9', 'volume_name': 'volume-6358eb29-139b-41de-88ce-7edb28dbfdf9', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5b8fe4-9c29-4bb8-90db-041ddb13d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5b8fe4-9c29-4bb8-90db-041ddb13d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ee69f-e10d-4523-b549-26813e988e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:22 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Volume 6358eb29-139b-41de-88ce-7edb28dbfdf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6358eb29-139b-41de-88ce-7edb28dbfdf9', 'volume_size': 1}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1138324224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6358eb29-139b-41de-88ce-7edb28dbfdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4584ecaa5a7444e9a2570b18e4f2d7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:39:23Z,use_quota=True,user_id='4f9e6060854d43128095637561462e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Creating volume 6358eb29-139b-41de-88ce-7edb28dbfdf9 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:39:22 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5180623-a87f-4f0b-b954-212d6fe07f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:22 devstack sudo[113467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 1073741824
Jun 26 00:39:22 devstack sudo[113467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9254e4a4-89ce-42dd-acbc-b9a3d8ad7286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:22 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Volume volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee (48435aaf-ae3a-4c42-be79-391d62ecf9ee): created successfully
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9254e4a4-89ce-42dd-acbc-b9a3d8ad7286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:22 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Flow 'volume_create_manager' (3378cef6-4032-45dd-999f-80ad9aa522dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-81305723-50be-4fac-ad66-727d5bd83cef tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Created volume successfully.
Jun 26 00:39:23 devstack sudo[113467]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 1073741824" returned: 0 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:23 devstack sudo[113476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9
Jun 26 00:39:23 devstack sudo[113476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:24 devstack sudo[113476]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9" returned: 0 in 0.623s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ee69f-e10d-4523-b549-26813e988e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6358eb29-139b-41de-88ce-7edb28dbfdf9', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc4f2e5-294c-4857-9ae7-7b6a74e65849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Volume volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 (6358eb29-139b-41de-88ce-7edb28dbfdf9): created successfully
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc4f2e5-294c-4857-9ae7-7b6a74e65849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Flow 'volume_create_manager' (4413cc79-da46-46c4-9c7d-afb112c007d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-373be5cc-05e0-4282-a899-5f47e36cda9d tempest-VolumesNegativeTest-1632528501 None] Created volume successfully.
Jun 26 00:39:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:26 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3d785f-4510-46aa-9d72-946d1dcf64d7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:26 devstack sudo[113491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee
Jun 26 00:39:26 devstack sudo[113491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:26 devstack sudo[113491]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee" returned: 0 in 0.754s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:27 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70617743-037b-48eb-8ccb-78c82fea6b5f', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:39:27 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-036103c4-103b-4e51-bc97-0dc5d4bd14d3 req-6518d18c-ec77-4b5a-b202-09a4731bd51a tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] attachment_update completed successfully.
Jun 26 00:39:33 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-f7b6b293-0c5b-4aae-8310-805fbfccb7e3 req-a5ab52fb-998d-4bf1-a1de-54ff528473b1 tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Terminate volume connection completed successfully.
Jun 26 00:39:33 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-f7b6b293-0c5b-4aae-8310-805fbfccb7e3 req-a5ab52fb-998d-4bf1-a1de-54ff528473b1 tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Deleting attachment 70617743-037b-48eb-8ccb-78c82fea6b5f. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:39:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Acquiring lock "cinder-48435aaf-ae3a-4c42-be79-391d62ecf9ee-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "cinder-48435aaf-ae3a-4c42-be79-391d62ecf9ee-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Acquiring lock "cinder-quobyte-48435aaf-ae3a-4c42-be79-391d62ecf9ee" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "cinder-quobyte-48435aaf-ae3a-4c42-be79-391d62ecf9ee" acquired by "delete_volume" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:35 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec315a92-d2e8-4cf3-8b2f-eb6c0aa2db27]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:36 devstack sudo[113969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee
Jun 26 00:39:36 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:36 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee" returned: 0 in 0.772s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:36 devstack sudo[113977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee
Jun 26 00:39:36 devstack sudo[113977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:37 devstack sudo[113977]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-48435aaf-ae3a-4c42-be79-391d62ecf9ee" returned: 0 in 0.789s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "cinder-quobyte-48435aaf-ae3a-4c42-be79-391d62ecf9ee" released by "delete_volume" :: held 1.623s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Created reservations ['5ad37f1d-8db4-4ecb-8e5c-c73b78d13f54', 'e81585c1-5d92-480e-8da6-7cba08b95a1d', 'cd90a188-289f-40f2-a901-5d4459f75d48', 'a5f4cdb0-33c4-4050-9de1-85626902573a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:37 devstack sudo[114040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:39:37 devstack sudo[114040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:38 devstack sudo[114040]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:38 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:39:38 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Deleted volume successfully.
Jun 26 00:39:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-06204dec-12a2-4c87-8e53-36bd5b98f7cf tempest-TestServerVolumeAttachScenarioOldVersion-1949915751 None] Lock "cinder-48435aaf-ae3a-4c42-be79-391d62ecf9ee-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:48 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=28,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Acquiring lock "cinder-6358eb29-139b-41de-88ce-7edb28dbfdf9-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Lock "cinder-6358eb29-139b-41de-88ce-7edb28dbfdf9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=43,cinder:DELETE=1,cinder:SELECT=32,cinder:INSERT=7 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Acquiring lock "cinder-quobyte-6358eb29-139b-41de-88ce-7edb28dbfdf9" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Lock "cinder-quobyte-6358eb29-139b-41de-88ce-7edb28dbfdf9" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2907f2-bf8a-469a-90c8-4d3314b7cd32]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:39:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:55 devstack sudo[114156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9
Jun 26 00:39:55 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:56 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9" returned: 0 in 0.792s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:56 devstack sudo[114161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9
Jun 26 00:39:56 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:56 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6358eb29-139b-41de-88ce-7edb28dbfdf9" returned: 0 in 0.642s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:56 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Lock "cinder-quobyte-6358eb29-139b-41de-88ce-7edb28dbfdf9" released by "delete_volume" :: held 1.485s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Created reservations ['5159d901-cff7-402c-8dd6-5a25b3e7eb25', '8d8eae89-4969-4f45-a099-4fea546e7ec1', '38cdf58f-402b-4a1e-a7b5-fed9a392c523', '374e430c-0353-4f07-9ab0-07048b2a2e7d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:57 devstack sudo[114164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:39:57 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Flow 'volume_create_manager' (dcb25665-dce6-4559-b3ef-07873398f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489e21db-c455-4508-a36e-276ad74c6003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489e21db-c455-4508-a36e-276ad74c6003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b43d5-3f64-4ad7-b0e2-b386f49c3723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883af2c823b44968a164809e28b0070a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:39:57Z,use_quota=True,user_id='085dea6840cd48e1808698847d0f724b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64787bf-12e7-45a1-9b5c-a87c1219f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64787bf-12e7-45a1-9b5c-a87c1219f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4fba93-fae3-41ea-a2ce-da7740e3bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4fba93-fae3-41ea-a2ce-da7740e3bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053b43d5-3f64-4ad7-b0e2-b386f49c3723', 'volume_name': 'volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ebb2a-dd29-4e37-8d83-1ae6a4353802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ebb2a-dd29-4e37-8d83-1ae6a4353802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14878899-ce58-40f5-bf23-e4042edd8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Volume 053b43d5-3f64-4ad7-b0e2-b386f49c3723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723', 'volume_size': 1}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b43d5-3f64-4ad7-b0e2-b386f49c3723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883af2c823b44968a164809e28b0070a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:39:57Z,use_quota=True,user_id='085dea6840cd48e1808698847d0f724b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Creating volume 053b43d5-3f64-4ad7-b0e2-b386f49c3723 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:39:57 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:57 devstack sudo[114166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 1073741824
Jun 26 00:39:57 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:57 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:39:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Deleted volume successfully.
Jun 26 00:39:57 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e9dcd346-b7dc-4397-b1f4-1e2c7eaf4bbd tempest-VolumesNegativeTest-1632528501 None] Lock "cinder-6358eb29-139b-41de-88ce-7edb28dbfdf9-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:39:58 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 1073741824" returned: 0 in 0.896s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:58 devstack sudo[114172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723
Jun 26 00:39:58 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:39:58 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723" returned: 0 in 0.730s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14878899-ce58-40f5-bf23-e4042edd8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3852d64c-a9b9-4459-bb2b-7975cb6f4343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Volume volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 (053b43d5-3f64-4ad7-b0e2-b386f49c3723): created successfully
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3852d64c-a9b9-4459-bb2b-7975cb6f4343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Flow 'volume_create_manager' (dcb25665-dce6-4559-b3ef-07873398f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:58 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e0cb2b41-3f2d-42f6-8e23-064d9345d2eb tempest-CinderUnicodeTest-709570405 None] Created volume successfully.
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Flow 'volume_create_manager' (bb182b93-c6dc-4a97-8a96-47fe326fc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25ff088-90ff-492e-87cc-b38dbe41efc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25ff088-90ff-492e-87cc-b38dbe41efc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1752534477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0956f8f9-87a4-49c1-aa28-7866da5d7f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883af2c823b44968a164809e28b0070a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:00Z,use_quota=True,user_id='085dea6840cd48e1808698847d0f724b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac156a8-b9b0-4e26-b86a-de8392b2b548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac156a8-b9b0-4e26-b86a-de8392b2b548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970f527e-b706-4e60-89df-c93acb99c99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970f527e-b706-4e60-89df-c93acb99c99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0956f8f9-87a4-49c1-aa28-7866da5d7f65', 'volume_name': 'volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814b6dc9-669d-4594-b120-79159fa6ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814b6dc9-669d-4594-b120-79159fa6ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45049e-fea8-4208-9f9b-bfde661352f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:39:59 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Volume 0956f8f9-87a4-49c1-aa28-7866da5d7f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65', 'volume_size': 1}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:39:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1752534477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0956f8f9-87a4-49c1-aa28-7866da5d7f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883af2c823b44968a164809e28b0070a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:00Z,use_quota=True,user_id='085dea6840cd48e1808698847d0f724b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Creating volume 0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:39:59 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:39:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:39:59 devstack sudo[114177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 1073741824
Jun 26 00:39:59 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Flow 'volume_create_manager' (78be1cb7-2835-42dc-aed3-aba9d67b5149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689b1ca8-2595-4eb5-8f22-1e9b6a8eef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689b1ca8-2595-4eb5-8f22-1e9b6a8eef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-63263810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06146596-b8f3-4fae-b44e-e82abf0bb840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908cf0cdc13746808483a65407196d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:00Z,use_quota=True,user_id='6b06c16888bf4f02a48d701a4c836749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec0b837-171a-4bbe-b8fa-b93309201f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec0b837-171a-4bbe-b8fa-b93309201f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c34126-2ff5-4aca-8735-b77e24321a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c34126-2ff5-4aca-8735-b77e24321a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06146596-b8f3-4fae-b44e-e82abf0bb840', 'volume_name': 'volume-06146596-b8f3-4fae-b44e-e82abf0bb840', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e30ca0-1ab9-4983-b565-2eebaaec862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e30ca0-1ab9-4983-b565-2eebaaec862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82516fbf-00e5-4e5e-a43f-72fce2d8a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Volume 06146596-b8f3-4fae-b44e-e82abf0bb840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06146596-b8f3-4fae-b44e-e82abf0bb840', 'volume_size': 1}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:00 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 1073741824" returned: 0 in 0.838s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:00 devstack sudo[114183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65
Jun 26 00:40:00 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:40:01 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65" returned: 0 in 0.633s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-63263810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06146596-b8f3-4fae-b44e-e82abf0bb840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908cf0cdc13746808483a65407196d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:00Z,use_quota=True,user_id='6b06c16888bf4f02a48d701a4c836749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Creating volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:40:01 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45049e-fea8-4208-9f9b-bfde661352f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:01 devstack sudo[114186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 1073741824
Jun 26 00:40:01 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c57526-8a76-41a0-ac8c-eed799271a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Volume volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 (0956f8f9-87a4-49c1-aa28-7866da5d7f65): created successfully
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c57526-8a76-41a0-ac8c-eed799271a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Flow 'volume_create_manager' (bb182b93-c6dc-4a97-8a96-47fe326fc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:40:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-610272b8-0d23-40ee-85dd-1d8b59ba38b7 tempest-CinderUnicodeTest-709570405 None] Created volume successfully.
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:02 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 1073741824" returned: 0 in 0.852s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:02 devstack sudo[114191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840
Jun 26 00:40:02 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:02 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840" returned: 0 in 0.623s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.829s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Creating offline snapshot cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 of volume 0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82516fbf-00e5-4e5e-a43f-72fce2d8a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06146596-b8f3-4fae-b44e-e82abf0bb840', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8e8991-0568-4986-8f0a-df241df55ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[341c27de-a44d-4830-9787-09c03995993e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Volume volume-06146596-b8f3-4fae-b44e-e82abf0bb840 (06146596-b8f3-4fae-b44e-e82abf0bb840): created successfully
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8e8991-0568-4986-8f0a-df241df55ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Flow 'volume_create_manager' (78be1cb7-2835-42dc-aed3-aba9d67b5149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:40:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-54c46dbf-ca1d-4bbf-829a-64d4ec3c0d77 tempest-VolumesSnapshotListTestJSON-470576393 None] Created volume successfully.
Jun 26 00:40:03 devstack sudo[114200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65
Jun 26 00:40:03 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:03 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65" returned: 0 in 0.755s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:03 devstack sudo[114205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 1G
Jun 26 00:40:03 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:04 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 1G" returned: 0 in 0.798s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:04 devstack sudo[114212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3
Jun 26 00:40:04 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:05 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" returned: 0 in 0.667s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:05 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 is being set with open permissions: ugo+rw
Jun 26 00:40:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:05 devstack sudo[114217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3
Jun 26 00:40:05 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:05 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" returned: 0 in 0.614s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:05 devstack sudo[114220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info
Jun 26 00:40:05 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:06 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info" returned: 0 in 0.618s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:06 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info is being set with open permissions: ugo+rw
Jun 26 00:40:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:06 devstack sudo[114223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info
Jun 26 00:40:06 devstack sudo[114223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:07 devstack sudo[114223]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.info" returned: 0 in 0.625s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.536s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Creating offline snapshot 2b2054f2-41fa-4b55-bc1e-5ab7303747fa of volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:40:07 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c0873776-9339-492c-95d7-d14da9def3b2 tempest-CinderUnicodeTest-709570405 None] Create snapshot completed successfully
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd2d89b-cef5-4565-a92c-248ebc6ddb8c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:07 devstack sudo[114226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840
Jun 26 00:40:07 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-cebb60e4-e3d7-48b1-a5a9-c631dcd630c3-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Lock "cinder-cebb60e4-e3d7-48b1-a5a9-c631dcd630c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-quobyte-0956f8f9-87a4-49c1-aa28-7866da5d7f65" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-0956f8f9-87a4-49c1-aa28-7866da5d7f65" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-quobyte-cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Deleting offline snapshot cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 of volume 0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] snapshot_file for this snap is: volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c52ff-cfef-4e77-9f02-639718b7fef8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:07 devstack sudo[114229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3
Jun 26 00:40:07 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:07 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840" returned: 0 in 0.772s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:07 devstack sudo[114234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa 1G
Jun 26 00:40:07 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:08 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" returned: 0 in 0.751s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca0650d-636d-4a61-bf77-2cfdf4d709e8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:08 devstack sudo[114241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65
Jun 26 00:40:08 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:08 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa 1G" returned: 0 in 0.787s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:08 devstack sudo[114246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:08 devstack sudo[114246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:08 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:08 devstack sudo[114252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3
Jun 26 00:40:08 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:09 devstack sudo[114246]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.671s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:09 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa is being set with open permissions: ugo+rw
Jun 26 00:40:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:09 devstack sudo[114257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:09 devstack sudo[114257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:09 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:09 devstack sudo[114262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3
Jun 26 00:40:09 devstack sudo[114262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:09 devstack sudo[114257]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.670s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:10 devstack sudo[114265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info
Jun 26 00:40:10 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:10 devstack sudo[114262]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65.cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" returned: 0 in 0.629s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-cebb60e4-e3d7-48b1-a5a9-c631dcd630c3" released by "_delete_snapshot" :: held 3.006s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-0956f8f9-87a4-49c1-aa28-7866da5d7f65" released by "delete_snapshot" :: held 3.041s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Created reservations ['69c71ab5-cc03-4e14-9c95-35075c632988', '3ca88215-019a-4055-afda-242212cbfc2a', 'c4007dd8-c5a0-4702-8bff-cad2dd1a0d9d', '14542bfe-cec7-4758-a28a-ab1542e4eebe'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Delete snapshot completed successfully.
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b667a80c-ddab-403a-a35a-1b1e04300cb8 tempest-CinderUnicodeTest-709570405 None] Lock "cinder-cebb60e4-e3d7-48b1-a5a9-c631dcd630c3-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:10 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info" returned: 0 in 0.683s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:10 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info is being set with open permissions: ugo+rw
Jun 26 00:40:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:10 devstack sudo[114269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info
Jun 26 00:40:10 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:11 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.info" returned: 0 in 0.642s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.315s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-da71803b-1021-47c1-a751-cae99dfb55b3 tempest-VolumesSnapshotListTestJSON-470576393 None] Create snapshot completed successfully
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-0956f8f9-87a4-49c1-aa28-7866da5d7f65-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Lock "cinder-0956f8f9-87a4-49c1-aa28-7866da5d7f65-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-quobyte-0956f8f9-87a4-49c1-aa28-7866da5d7f65" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-0956f8f9-87a4-49c1-aa28-7866da5d7f65" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9635d20b-e86e-499d-ac4d-9d0769f09e9b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:11 devstack sudo[114272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65
Jun 26 00:40:11 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Creating offline snapshot 670c3f21-5b14-4a8f-92d3-c18c093d374e of volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bddcca5-1c9b-4f6b-8c5c-2699bdd2f315]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:12 devstack sudo[114274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:12 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:12 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65" returned: 0 in 0.773s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:12 devstack sudo[114279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65
Jun 26 00:40:12 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:12 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.777s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:12 devstack sudo[114284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e 1G
Jun 26 00:40:12 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:13 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0956f8f9-87a4-49c1-aa28-7866da5d7f65" returned: 0 in 0.643s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-0956f8f9-87a4-49c1-aa28-7866da5d7f65" released by "delete_volume" :: held 1.472s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Created reservations ['66b94108-e6f2-435a-bbeb-3c2c3957f891', '7b631cf8-a229-4258-888a-65ca8d7da3e0', '554c19a6-a89c-49df-a1bb-1c1ebc40c6f3', '7ee109fa-3d9e-44c2-a1ea-d44addd61661'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:13 devstack sudo[114287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:40:13 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:13 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e 1G" returned: 0 in 0.829s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:13 devstack sudo[114292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:13 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-053b43d5-3f64-4ad7-b0e2-b386f49c3723-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Lock "cinder-053b43d5-3f64-4ad7-b0e2-b386f49c3723-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Acquiring lock "cinder-quobyte-053b43d5-3f64-4ad7-b0e2-b386f49c3723" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-053b43d5-3f64-4ad7-b0e2-b386f49c3723" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:13 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f212ec4-383a-4740-ae39-e41fdd710448]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.695s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:40:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Deleted volume successfully.
Jun 26 00:40:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8bbfce72-3d21-499c-9ff5-9adaf0af204f tempest-CinderUnicodeTest-709570405 None] Lock "cinder-0956f8f9-87a4-49c1-aa28-7866da5d7f65-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:13 devstack sudo[114295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723
Jun 26 00:40:13 devstack sudo[114295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:14 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.713s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:14 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e is being set with open permissions: ugo+rw
Jun 26 00:40:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:14 devstack sudo[114300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:14 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:14 devstack sudo[114295]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723" returned: 0 in 0.791s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:14 devstack sudo[114306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723
Jun 26 00:40:14 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:14 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.634s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-cddd528a-8917-4e58-a956-8eced2eaa393 tempest-VolumesSnapshotListTestJSON-470576393 None] Create snapshot completed successfully
Jun 26 00:40:15 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-053b43d5-3f64-4ad7-b0e2-b386f49c3723" returned: 0 in 0.642s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Lock "cinder-quobyte-053b43d5-3f64-4ad7-b0e2-b386f49c3723" released by "delete_volume" :: held 1.472s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Created reservations ['fa2b5261-3cec-4864-b689-1f0de58cae06', 'd6bd97bb-e89e-4051-97cc-8cf934096cbb', 'd17c3c23-53b1-411d-85e4-1388d34eadba', 'a74b6b24-2439-44b9-aec6-8f861286b89b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:15 devstack sudo[114310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:40:15 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:16 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.638s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:40:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Deleted volume successfully.
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-45e06158-923c-414c-942e-5ca41ea27e5b tempest-CinderUnicodeTest-709570405 None] Lock "cinder-053b43d5-3f64-4ad7-b0e2-b386f49c3723-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Creating offline snapshot 6424225e-e20b-47ec-88d9-d8eb37986366 of volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4b7dd6-29ed-4694-b4cb-12c822e081e3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:16 devstack sudo[114313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:16 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:17 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.757s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:17 devstack sudo[114319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 1G
Jun 26 00:40:17 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:18 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 1G" returned: 0 in 0.939s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:18 devstack sudo[114324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366
Jun 26 00:40:18 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:18 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366" returned: 0 in 0.677s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:18 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 is being set with open permissions: ugo+rw
Jun 26 00:40:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:18 devstack sudo[114329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366
Jun 26 00:40:18 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:19 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366" returned: 0 in 0.658s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.124s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f961b662-3bb0-4597-8a64-b8317c441925 tempest-VolumesSnapshotListTestJSON-470576393 None] Create snapshot completed successfully
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-6424225e-e20b-47ec-88d9-d8eb37986366-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-6424225e-e20b-47ec-88d9-d8eb37986366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-6424225e-e20b-47ec-88d9-d8eb37986366" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-6424225e-e20b-47ec-88d9-d8eb37986366" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Deleting offline snapshot 6424225e-e20b-47ec-88d9-d8eb37986366 of volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] snapshot_file for this snap is: volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5cd3d-6b58-4b3e-b18d-424c2895d09b]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:21 devstack sudo[114332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366
Jun 26 00:40:21 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:22 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366" returned: 0 in 0.757s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed29758-3b65-4bfd-9adf-14098a60b64a]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:22 devstack sudo[114337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:22 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:22 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.745s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:22 devstack sudo[114342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366
Jun 26 00:40:22 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:23 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366" returned: 0 in 0.779s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:23 devstack sudo[114347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366
Jun 26 00:40:23 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:24 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.6424225e-e20b-47ec-88d9-d8eb37986366" returned: 0 in 0.652s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-6424225e-e20b-47ec-88d9-d8eb37986366" released by "_delete_snapshot" :: held 3.030s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" released by "delete_snapshot" :: held 3.055s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:24 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Created reservations ['ea0e79dd-477f-459a-a27c-91eae085ba84', '16327351-8a62-483c-b33c-4b4574e661d2', '623207d7-eee9-4ba2-9584-3a93d1d562a6', '7254e486-445c-458f-a498-d60ff735b3d8'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:24 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Delete snapshot completed successfully.
Jun 26 00:40:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ddfeb827-235e-42cd-9349-bff0021ce8be tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-6424225e-e20b-47ec-88d9-d8eb37986366-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-670c3f21-5b14-4a8f-92d3-c18c093d374e-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-670c3f21-5b14-4a8f-92d3-c18c093d374e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-670c3f21-5b14-4a8f-92d3-c18c093d374e" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-670c3f21-5b14-4a8f-92d3-c18c093d374e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Deleting offline snapshot 670c3f21-5b14-4a8f-92d3-c18c093d374e of volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] snapshot_file for this snap is: volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b418e6-7dc1-4e77-a28e-ad771feb94d1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:25 devstack sudo[114351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:25 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:26 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.746s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:26 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e72dda-3975-4418-a188-ce20be8cbd6e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:26 devstack sudo[114356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:26 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:27 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.749s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:27 devstack sudo[114361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:27 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:27 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.763s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:27 devstack sudo[114366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e
Jun 26 00:40:27 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:28 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.670c3f21-5b14-4a8f-92d3-c18c093d374e" returned: 0 in 0.663s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-670c3f21-5b14-4a8f-92d3-c18c093d374e" released by "_delete_snapshot" :: held 3.013s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" released by "delete_snapshot" :: held 3.036s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:28 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Created reservations ['c824c404-14a9-4c3d-abe1-b2aaef639eab', '3b5168c8-0a73-4816-b814-ad086b5bfc70', '598ee6ac-4d4b-407c-850a-5a6558f32dae', 'd643d80b-2954-481e-b405-7dfc889f6f97'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:28 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Delete snapshot completed successfully.
Jun 26 00:40:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3fbd774f-002a-4ab8-becf-c505e9f6c61b tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-670c3f21-5b14-4a8f-92d3-c18c093d374e-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-2b2054f2-41fa-4b55-bc1e-5ab7303747fa-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-2b2054f2-41fa-4b55-bc1e-5ab7303747fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-2b2054f2-41fa-4b55-bc1e-5ab7303747fa" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-2b2054f2-41fa-4b55-bc1e-5ab7303747fa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Deleting offline snapshot 2b2054f2-41fa-4b55-bc1e-5ab7303747fa of volume 06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] snapshot_file for this snap is: volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[92088639-ff6c-4485-8a8e-15c2c9be898f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:29 devstack sudo[114369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:29 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:30 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.762s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06146596-b8f3-4fae-b44e-e82abf0bb840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:40:30 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67f98af-e4d7-431b-909a-b9329461cc31]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:30 devstack sudo[114374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840
Jun 26 00:40:30 devstack sudo[114374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:31 devstack sudo[114374]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840" returned: 0 in 0.786s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:31 devstack sudo[114380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:31 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:32 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.766s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:32 devstack sudo[114422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa
Jun 26 00:40:32 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:32 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840.2b2054f2-41fa-4b55-bc1e-5ab7303747fa" returned: 0 in 0.630s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-2b2054f2-41fa-4b55-bc1e-5ab7303747fa" released by "_delete_snapshot" :: held 3.040s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" released by "delete_snapshot" :: held 3.060s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Created reservations ['30b4cf4f-c456-4536-b5a3-610a645aca54', '1fc30059-853a-49b3-81c4-a2ed9ac3964b', '5dba538c-df4e-4989-8579-460add7a8330', '3d700e07-08dc-4a93-9bcf-d3c75243f94d'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Delete snapshot completed successfully.
Jun 26 00:40:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1a93940-c54c-4faf-9ba9-7c7103f91099 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-2b2054f2-41fa-4b55-bc1e-5ab7303747fa-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-06146596-b8f3-4fae-b44e-e82abf0bb840-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-06146596-b8f3-4fae-b44e-e82abf0bb840-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:40:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:40:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb2ad5b-da8d-4dc2-a7f9-476a1afcc282]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:40:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:34 devstack sudo[114425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840
Jun 26 00:40:34 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:34 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840" returned: 0 in 0.766s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:34 devstack sudo[114432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840
Jun 26 00:40:34 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:35 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-06146596-b8f3-4fae-b44e-e82abf0bb840" returned: 0 in 0.632s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-quobyte-06146596-b8f3-4fae-b44e-e82abf0bb840" released by "delete_volume" :: held 1.454s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Created reservations ['b8a86eea-c1ab-48ed-ad7c-4de90b0de446', 'dde4545e-2c78-4519-8f5f-359d044b8628', 'beac4980-13bb-4c0d-9a6b-39986e338c21', '4c2c4aa8-3f0f-447b-ad83-21be06771c9c'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:35 devstack sudo[114435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:40:35 devstack sudo[114435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:36 devstack sudo[114435]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.640s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:36 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:40:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Deleted volume successfully.
Jun 26 00:40:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3efac438-1ad5-4c97-81ef-e243535b26d4 tempest-VolumesSnapshotListTestJSON-470576393 None] Lock "cinder-06146596-b8f3-4fae-b44e-e82abf0bb840-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:40:45 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=69,cinder:SELECT=57,cinder:INSERT=20,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:40:46 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=58,cinder:INSERT=17,cinder:UPDATE=67,cinder:DELETE=9 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Flow 'volume_create_manager' (48a26bec-e12a-4a31-ade3-c9b9dceb8788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2a4d36-da69-457d-b272-aa60f453be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2a4d36-da69-457d-b272-aa60f453be0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-506245075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5eab67-1f9a-4517-8388-d64203c91239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91489c0bc22946458949b30f4c07ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:59Z,use_quota=True,user_id='718f7df8f97847fd9e0c84fbf2567cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dcad9f-8c20-419a-b242-9e1624da055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dcad9f-8c20-419a-b242-9e1624da055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d3fe27-7751-415f-bac1-b5321e0508fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d3fe27-7751-415f-bac1-b5321e0508fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5eab67-1f9a-4517-8388-d64203c91239', 'volume_name': 'volume-af5eab67-1f9a-4517-8388-d64203c91239', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05913a42-cf23-42bc-93b8-ec582fdb8e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05913a42-cf23-42bc-93b8-ec582fdb8e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9092c5-0e5e-4fa7-9199-94d91fdd58cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Volume af5eab67-1f9a-4517-8388-d64203c91239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5eab67-1f9a-4517-8388-d64203c91239', 'volume_size': 1}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-506245075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5eab67-1f9a-4517-8388-d64203c91239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91489c0bc22946458949b30f4c07ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:59Z,use_quota=True,user_id='718f7df8f97847fd9e0c84fbf2567cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Creating volume af5eab67-1f9a-4517-8388-d64203c91239 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:40:58 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:40:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:40:59 devstack sudo[114444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 1073741824
Jun 26 00:40:59 devstack sudo[114444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Flow 'volume_create_manager' (9019a9d1-d939-4328-a249-cd9f8fb58176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434c65e4-ba14-4ba2-bedf-aa5980e403d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434c65e4-ba14-4ba2-bedf-aa5980e403d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-581199282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5b28e7-5cd7-4c07-84a0-cda699e32f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91489c0bc22946458949b30f4c07ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:59Z,use_quota=True,user_id='718f7df8f97847fd9e0c84fbf2567cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1278fc4-d0aa-49ae-909d-4ce8da38e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1278fc4-d0aa-49ae-909d-4ce8da38e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d9a2a-d7d8-486b-9450-d082bed273a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d9a2a-d7d8-486b-9450-d082bed273a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5b28e7-5cd7-4c07-84a0-cda699e32f1d', 'volume_name': 'volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab5576f-b541-40f4-b6a6-65b1b50c9cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab5576f-b541-40f4-b6a6-65b1b50c9cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c217b7a3-c2fc-4d89-8101-98d2132557fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:40:59 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Volume 1b5b28e7-5cd7-4c07-84a0-cda699e32f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d', 'volume_size': 1}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:40:59 devstack sudo[114444]: pam_unix(sudo:session): session closed for user root
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 1073741824" returned: 0 in 0.966s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:40:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:41:00 devstack sudo[114451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239
Jun 26 00:41:00 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:41:00 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239" returned: 0 in 0.646s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-581199282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5b28e7-5cd7-4c07-84a0-cda699e32f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91489c0bc22946458949b30f4c07ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:40:59Z,use_quota=True,user_id='718f7df8f97847fd9e0c84fbf2567cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Creating volume 1b5b28e7-5cd7-4c07-84a0-cda699e32f1d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:41:00 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9092c5-0e5e-4fa7-9199-94d91fdd58cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5eab67-1f9a-4517-8388-d64203c91239', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:41:00 devstack sudo[114454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d 1073741824
Jun 26 00:41:00 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2991631d-ddff-4bc0-869d-b68eb07cdca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:41:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Volume volume-af5eab67-1f9a-4517-8388-d64203c91239 (af5eab67-1f9a-4517-8388-d64203c91239): created successfully
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2991631d-ddff-4bc0-869d-b68eb07cdca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:41:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Flow 'volume_create_manager' (48a26bec-e12a-4a31-ade3-c9b9dceb8788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:41:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-73ba304a-681c-462a-8c03-0b11cea54865 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Created volume successfully.
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:41:01 devstack sudo[114456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:41:01 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:41:01 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d 1073741824" returned: 0 in 0.902s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:41:01 devstack sudo[114461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d
Jun 26 00:41:01 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:41:01 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.699s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:41:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:41:02 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" returned: 0 in 0.684s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c217b7a3-c2fc-4d89-8101-98d2132557fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa7f209-1e5a-4e7c-b66c-401387afd07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:41:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Volume volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d (1b5b28e7-5cd7-4c07-84a0-cda699e32f1d): created successfully
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa7f209-1e5a-4e7c-b66c-401387afd07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:41:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Flow 'volume_create_manager' (9019a9d1-d939-4328-a249-cd9f8fb58176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:41:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3d88a657-6127-454f-b9a6-a4d7894fa8c9 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Created volume successfully.
Jun 26 00:41:12 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:41:12 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=2 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:41:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:41:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:41:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd1e153-483a-4efa-b692-e290b46569cb]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:41:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:41:41 devstack sudo[114659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239
Jun 26 00:41:41 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:41:42 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root
Jun 26 00:41:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239" returned: 0 in 0.775s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:41:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.792s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:41:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-af5eab67-1f9a-4517-8388-d64203c91239', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2dec1852-ce71-43be-839f-3ae3e704bc23', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:41:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-e4934231-df36-4846-831b-6988195b9ba7 req-fcaee183-f486-4ce3-a7f5-6ffc439fbd74 tempest-TestServerVolumeAttachmentScenario-1464517430 None] attachment_update completed successfully.
Jun 26 00:41:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:41:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:41:50 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5462c52b-925c-4be4-974d-e3a5b7327a3d]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:41:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:41:50 devstack sudo[115061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d
Jun 26 00:41:50 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:41:51 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root
Jun 26 00:41:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" returned: 0 in 0.736s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:41:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.752s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:41:51 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2', 'name': 'volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d951079-3fc8-4d54-8274-ae7a47b3bfad', 'enforce_multipath': True} {{(pid=94563) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 00:41:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-b135c98a-ceea-4e0f-848d-4b54f307c02c req-5113b8fd-1943-4c59-b41e-7104f922f3e5 tempest-TestServerVolumeAttachmentScenario-1464517430 None] attachment_update completed successfully.
Jun 26 00:41:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-c6da61e2-c31b-453e-8a68-c6780b28081d req-6bc0712e-8e18-455e-b73e-2f74ce3e6311 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Terminate volume connection completed successfully.
Jun 26 00:41:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-c6da61e2-c31b-453e-8a68-c6780b28081d req-6bc0712e-8e18-455e-b73e-2f74ce3e6311 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Deleting attachment 0d951079-3fc8-4d54-8274-ae7a47b3bfad. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [req-4ac00006-b631-461b-b850-9299c07a2049 req-430b19f0-4cb2-4f89-a39f-2f86fb949ff1 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Terminate volume connection completed successfully.
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [req-4ac00006-b631-461b-b850-9299c07a2049 req-430b19f0-4cb2-4f89-a39f-2f86fb949ff1 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Deleting attachment 2dec1852-ce71-43be-839f-3ae3e704bc23. {{(pid=94563) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 00:42:01 devstack sudo[115110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:01 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:01 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.635s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:42:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:42:10 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:42:10 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "cinder-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "cinder-quobyte-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-quobyte-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" acquired by "delete_volume" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[912070f3-a09e-4653-9857-4463a351db76]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:11 devstack sudo[115176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d
Jun 26 00:42:11 devstack sudo[115176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:11 devstack sudo[115176]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" returned: 0 in 0.751s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:11 devstack sudo[115181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d
Jun 26 00:42:11 devstack sudo[115181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:12 devstack sudo[115181]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" returned: 0 in 0.612s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-quobyte-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d" released by "delete_volume" :: held 1.416s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Created reservations ['b9cf5738-5687-49e0-8c0c-ef220d7e782b', '759afde5-42ed-4572-951f-00c493e88421', '8adfda69-2ff0-408e-82c3-8bc3efac8ac1', 'c17499c6-78db-4dc5-8293-86fc1b809719'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:12 devstack sudo[115184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:12 devstack sudo[115184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "cinder-af5eab67-1f9a-4517-8388-d64203c91239-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:13 devstack sudo[115184]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.636s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-af5eab67-1f9a-4517-8388-d64203c91239-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Deleted volume successfully.
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-491766c4-54ea-4cd7-832c-c4658872d302 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-1b5b28e7-5cd7-4c07-84a0-cda699e32f1d-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "cinder-quobyte-af5eab67-1f9a-4517-8388-d64203c91239" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-quobyte-af5eab67-1f9a-4517-8388-d64203c91239" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8d25c-6951-4c24-8281-36ed41598591]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:13 devstack sudo[115187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239
Jun 26 00:42:13 devstack sudo[115187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:14 devstack sudo[115187]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239" returned: 0 in 0.728s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:14 devstack sudo[115192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239
Jun 26 00:42:14 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:14 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-af5eab67-1f9a-4517-8388-d64203c91239" returned: 0 in 0.636s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-quobyte-af5eab67-1f9a-4517-8388-d64203c91239" released by "delete_volume" :: held 1.400s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Created reservations ['f484c9de-44f3-46f5-bd02-e29b09d93c93', '2d435e06-ef6b-45cd-8cdd-0525909957dd', '7e30ec73-e161-4200-a59c-922c0517e317', '03e76035-91ae-4dc8-baad-6b9f72b2aca7'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:14 devstack sudo[115196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:14 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:15 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.622s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:15 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Deleted volume successfully.
Jun 26 00:42:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-23e7a5f4-fa60-41a0-8fe2-f5e8277e9018 tempest-TestServerVolumeAttachmentScenario-1464517430 None] Lock "cinder-af5eab67-1f9a-4517-8388-d64203c91239-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=16 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (b37e5405-537c-4706-8a7f-849cc8508245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea229528-5654-4f9e-a186-be0d8ab4d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea229528-5654-4f9e-a186-be0d8ab4d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1723307264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57447581-c11b-4ad5-9983-42de2ec24bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:25Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99a55fa-1586-4d05-87a6-7ab14499527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99a55fa-1586-4d05-87a6-7ab14499527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1443b408-d585-444c-9e2a-b85b0404085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1443b408-d585-444c-9e2a-b85b0404085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57447581-c11b-4ad5-9983-42de2ec24bab', 'volume_name': 'volume-57447581-c11b-4ad5-9983-42de2ec24bab', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24775018-fc6b-49dd-b01e-c3778f8c258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24775018-fc6b-49dd-b01e-c3778f8c258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04baacb5-cdc9-4249-86db-176b2e9703d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:24 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Volume 57447581-c11b-4ad5-9983-42de2ec24bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57447581-c11b-4ad5-9983-42de2ec24bab', 'volume_size': 1}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1723307264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57447581-c11b-4ad5-9983-42de2ec24bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:25Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Creating volume 57447581-c11b-4ad5-9983-42de2ec24bab {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:24 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:25 devstack sudo[115204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab 1073741824
Jun 26 00:42:25 devstack sudo[115204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (87144aa9-9c27-40ee-bca4-119d94cb904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd093b-e6b1-4398-90e7-d560380b63c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd093b-e6b1-4398-90e7-d560380b63c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1074934950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935b400c-ab27-4722-b326-f391bbf4eda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:25Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0129a4b5-73c9-4775-a7f3-2a0d4897f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0129a4b5-73c9-4775-a7f3-2a0d4897f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbf8ab-b45d-421b-b6b0-c97aa20f5f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbf8ab-b45d-421b-b6b0-c97aa20f5f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935b400c-ab27-4722-b326-f391bbf4eda5', 'volume_name': 'volume-935b400c-ab27-4722-b326-f391bbf4eda5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f816d2-9667-4f46-8234-ac07bc5b4446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f816d2-9667-4f46-8234-ac07bc5b4446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b87b13d-3754-4005-8eda-ea97389c2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Volume 935b400c-ab27-4722-b326-f391bbf4eda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935b400c-ab27-4722-b326-f391bbf4eda5', 'volume_size': 1}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (1cfd003c-0c0f-48fd-861e-33b5c22104f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e0d6b1-8295-4e00-b356-b16c28203aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e0d6b1-8295-4e00-b356-b16c28203aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1696641864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb9dc02-5424-42cb-b003-99c48a5e4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:26Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41829a7f-04c6-4726-bc17-20c0789cf57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41829a7f-04c6-4726-bc17-20c0789cf57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fb91c9-69ff-4f28-8600-b0c545774142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fb91c9-69ff-4f28-8600-b0c545774142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb9dc02-5424-42cb-b003-99c48a5e4666', 'volume_name': 'volume-5bb9dc02-5424-42cb-b003-99c48a5e4666', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3458964-f2a3-445f-8604-2e0f9e8fdb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3458964-f2a3-445f-8604-2e0f9e8fdb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42982948-6575-420c-9ce3-9c73639893d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:25 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Volume 5bb9dc02-5424-42cb-b003-99c48a5e4666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb9dc02-5424-42cb-b003-99c48a5e4666', 'volume_size': 1}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:25 devstack sudo[115204]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab 1073741824" returned: 0 in 0.897s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:25 devstack sudo[115210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab
Jun 26 00:42:25 devstack sudo[115210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (6b28461f-48e3-4fed-b630-20a09e2ea903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2694d803-0ec2-49e9-83c1-091d62b888b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2694d803-0ec2-49e9-83c1-091d62b888b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2068505914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4287ca13-9824-4ae3-a000-80da5b784165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:26Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea674283-3c3b-4bd7-ab2c-680964a78426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea674283-3c3b-4bd7-ab2c-680964a78426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ef0ec5-e55b-4881-bfa4-b1d959dc0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ef0ec5-e55b-4881-bfa4-b1d959dc0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4287ca13-9824-4ae3-a000-80da5b784165', 'volume_name': 'volume-4287ca13-9824-4ae3-a000-80da5b784165', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61b98b5-8dfc-4c38-b6ff-06dc024f4105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61b98b5-8dfc-4c38-b6ff-06dc024f4105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffbde62-c313-4919-8e16-d59c5b5ed647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Volume 4287ca13-9824-4ae3-a000-80da5b784165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4287ca13-9824-4ae3-a000-80da5b784165', 'volume_size': 1}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (b9156ed9-8c8a-480d-a855-36e540cbd138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cbd3091-4a5d-4cbe-874a-45915e109992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cbd3091-4a5d-4cbe-874a-45915e109992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882561382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcd26ba-5d53-452e-b228-5c5df4ca21f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:26Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d09020-076b-4d4a-9232-4820c5a531a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d09020-076b-4d4a-9232-4820c5a531a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59975ad-4522-4a7f-bbfe-d0c22089b8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59975ad-4522-4a7f-bbfe-d0c22089b8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcd26ba-5d53-452e-b228-5c5df4ca21f3', 'volume_name': 'volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea9039d-d468-435c-bc27-92d6090b39e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea9039d-d468-435c-bc27-92d6090b39e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7d5cc7-2a1d-4307-bb72-e06ffc235a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Volume 6fcd26ba-5d53-452e-b228-5c5df4ca21f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3', 'volume_size': 1}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:26 devstack sudo[115210]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab" returned: 0 in 0.639s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1074934950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935b400c-ab27-4722-b326-f391bbf4eda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:25Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Creating volume 935b400c-ab27-4722-b326-f391bbf4eda5 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:26 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:26 devstack sudo[115213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5 1073741824
Jun 26 00:42:26 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04baacb5-cdc9-4249-86db-176b2e9703d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57447581-c11b-4ad5-9983-42de2ec24bab', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ce703b-d884-42bd-9661-ce9aa62d2bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Volume volume-57447581-c11b-4ad5-9983-42de2ec24bab (57447581-c11b-4ad5-9983-42de2ec24bab): created successfully
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ce703b-d884-42bd-9661-ce9aa62d2bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (b37e5405-537c-4706-8a7f-849cc8508245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e5f7ac87-9b39-4126-934a-e9d76cb0e0ca tempest-CreateVolumesFromImageTest-1290494339 None] Created volume successfully.
Jun 26 00:42:27 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5 1073741824" returned: 0 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:27 devstack sudo[115219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5
Jun 26 00:42:27 devstack sudo[115219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:28 devstack sudo[115219]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5" returned: 0 in 0.621s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.347s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1696641864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb9dc02-5424-42cb-b003-99c48a5e4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:26Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Creating volume 5bb9dc02-5424-42cb-b003-99c48a5e4666 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:28 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:28 devstack sudo[115222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 1073741824
Jun 26 00:42:28 devstack sudo[115222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b87b13d-3754-4005-8eda-ea97389c2435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935b400c-ab27-4722-b326-f391bbf4eda5', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1729cf-ab7e-469c-848a-1dbd711507af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:28 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Volume volume-935b400c-ab27-4722-b326-f391bbf4eda5 (935b400c-ab27-4722-b326-f391bbf4eda5): created successfully
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1729cf-ab7e-469c-848a-1dbd711507af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (87144aa9-9c27-40ee-bca4-119d94cb904a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:28 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-54ea54e3-3a83-49da-8da4-c51d55916aa1 tempest-CreateVolumesFromImageTest-1290494339 None] Created volume successfully.
Jun 26 00:42:28 devstack sudo[115222]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 1073741824" returned: 0 in 0.792s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:28 devstack sudo[115228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666
Jun 26 00:42:28 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:29 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666" returned: 0 in 0.624s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2068505914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4287ca13-9824-4ae3-a000-80da5b784165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:26Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Creating volume 4287ca13-9824-4ae3-a000-80da5b784165 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:29 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42982948-6575-420c-9ce3-9c73639893d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb9dc02-5424-42cb-b003-99c48a5e4666', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:29 devstack sudo[115231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165 1073741824
Jun 26 00:42:29 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da825cd6-3c9a-404c-8ee7-77d5f18c1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:29 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Volume volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 (5bb9dc02-5424-42cb-b003-99c48a5e4666): created successfully
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da825cd6-3c9a-404c-8ee7-77d5f18c1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:29 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (1cfd003c-0c0f-48fd-861e-33b5c22104f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-90676737-cc9d-4455-b771-fcb5469b51ee tempest-CreateVolumesFromImageTest-1290494339 None] Created volume successfully.
Jun 26 00:42:30 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165 1073741824" returned: 0 in 0.810s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:30 devstack sudo[115237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165
Jun 26 00:42:30 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:30 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165" returned: 0 in 0.609s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.569s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882561382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcd26ba-5d53-452e-b228-5c5df4ca21f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b81e9f86a4eeab956b7939f8b21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:26Z,use_quota=True,user_id='4681991abd4b44688dd772c2cd6cc0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Creating volume 6fcd26ba-5d53-452e-b228-5c5df4ca21f3 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:30 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:31 devstack sudo[115240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 1073741824
Jun 26 00:42:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffbde62-c313-4919-8e16-d59c5b5ed647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4287ca13-9824-4ae3-a000-80da5b784165', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:31 devstack sudo[115240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dba24b-caa4-47b4-be5a-7f9734adfe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:31 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Volume volume-4287ca13-9824-4ae3-a000-80da5b784165 (4287ca13-9824-4ae3-a000-80da5b784165): created successfully
Jun 26 00:42:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dba24b-caa4-47b4-be5a-7f9734adfe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:31 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (6b28461f-48e3-4fed-b630-20a09e2ea903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:31 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-98136f4a-c982-44b9-9c86-d07175b92c0a tempest-CreateVolumesFromImageTest-1290494339 None] Created volume successfully.
Jun 26 00:42:31 devstack sudo[115240]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 1073741824" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:31 devstack sudo[115246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3
Jun 26 00:42:31 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:32 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3" returned: 0 in 0.639s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7d5cc7-2a1d-4307-bb72-e06ffc235a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f46b6f-f57f-43c4-bd76-67f24e0be175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:32 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Volume volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 (6fcd26ba-5d53-452e-b228-5c5df4ca21f3): created successfully
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f46b6f-f57f-43c4-bd76-67f24e0be175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Flow 'volume_create_manager' (b9156ed9-8c8a-480d-a855-36e540cbd138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:32 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b9e45487-e075-48d3-86d2-4c91dc207d61 tempest-CreateVolumesFromImageTest-1290494339 None] Created volume successfully.
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-6fcd26ba-5d53-452e-b228-5c5df4ca21f3-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-6fcd26ba-5d53-452e-b228-5c5df4ca21f3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-quobyte-6fcd26ba-5d53-452e-b228-5c5df4ca21f3" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-6fcd26ba-5d53-452e-b228-5c5df4ca21f3" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691fadf-80a9-4434-accc-60e22d6e7498]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:33 devstack sudo[115285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3
Jun 26 00:42:33 devstack sudo[115285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:33 devstack sudo[115285]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3" returned: 0 in 0.756s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:33 devstack sudo[115290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3
Jun 26 00:42:33 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:34 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-6fcd26ba-5d53-452e-b228-5c5df4ca21f3" returned: 0 in 0.641s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-6fcd26ba-5d53-452e-b228-5c5df4ca21f3" released by "delete_volume" :: held 1.437s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Created reservations ['debf8907-98f9-44a5-8d4f-28643fce619e', '9ce32d0f-fe94-4cdd-8803-e10588405c53', 'f75cb87b-c357-42fc-9698-6670149503bb', '7ad8bcde-2109-4d36-9173-ba5af9970c88'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:34 devstack sudo[115293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:34 devstack sudo[115293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-4287ca13-9824-4ae3-a000-80da5b784165-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-4287ca13-9824-4ae3-a000-80da5b784165-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:35 devstack sudo[115293]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.639s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:35 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Deleted volume successfully.
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-quobyte-4287ca13-9824-4ae3-a000-80da5b784165" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-3665ef12-116e-4d0a-a2b6-56147b7e7188 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-6fcd26ba-5d53-452e-b228-5c5df4ca21f3-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-4287ca13-9824-4ae3-a000-80da5b784165" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af60ffd-1e8d-45ef-9278-0906d75b80ce]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:35 devstack sudo[115297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165
Jun 26 00:42:35 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:35 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165" returned: 0 in 0.739s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:35 devstack sudo[115302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165
Jun 26 00:42:35 devstack sudo[115302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:36 devstack sudo[115302]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4287ca13-9824-4ae3-a000-80da5b784165" returned: 0 in 0.613s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-4287ca13-9824-4ae3-a000-80da5b784165" released by "delete_volume" :: held 1.389s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Created reservations ['5505a522-918a-4e58-854e-80dafd9154f2', '5ef9f324-e75f-4a43-b967-018899538a80', '5a2f508f-6153-458a-98d5-9e8611e96358', 'a28effa5-1778-4a27-9152-49ea06c57e56'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:36 devstack sudo[115305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:36 devstack sudo[115305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:37 devstack sudo[115305]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.618s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Deleted volume successfully.
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-5bb9dc02-5424-42cb-b003-99c48a5e4666-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-bc29cfb4-76ab-4621-85ce-e392d119e935 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-4287ca13-9824-4ae3-a000-80da5b784165-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-5bb9dc02-5424-42cb-b003-99c48a5e4666-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-quobyte-5bb9dc02-5424-42cb-b003-99c48a5e4666" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-5bb9dc02-5424-42cb-b003-99c48a5e4666" acquired by "delete_volume" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3d7fb4-293f-4e78-814b-ac241b0585f8]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:37 devstack sudo[115308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666
Jun 26 00:42:37 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:38 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666" returned: 0 in 0.759s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:38 devstack sudo[115313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666
Jun 26 00:42:38 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:38 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-5bb9dc02-5424-42cb-b003-99c48a5e4666" returned: 0 in 0.637s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-5bb9dc02-5424-42cb-b003-99c48a5e4666" released by "delete_volume" :: held 1.436s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Created reservations ['5f5d9d47-4812-4868-ac2c-6b5de4388834', 'd3a25c6a-dae0-4587-a371-177f38b45ede', '92fcb111-5151-4c82-931e-98984e286fb9', '04733bab-cd64-49f3-854e-230a6868d568'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:38 devstack sudo[115316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:38 devstack sudo[115316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-935b400c-ab27-4722-b326-f391bbf4eda5-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-935b400c-ab27-4722-b326-f391bbf4eda5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:39 devstack sudo[115316]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.648s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:39 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Deleted volume successfully.
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-quobyte-935b400c-ab27-4722-b326-f391bbf4eda5" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-935b400c-ab27-4722-b326-f391bbf4eda5" acquired by "delete_volume" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-01d4e7bb-6fe5-4b91-b031-356110a83ee7 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-5bb9dc02-5424-42cb-b003-99c48a5e4666-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[49681b9a-cde6-4637-9888-8cbcd7214792]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:39 devstack sudo[115319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5
Jun 26 00:42:39 devstack sudo[115319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:40 devstack sudo[115319]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5" returned: 0 in 0.729s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:40 devstack sudo[115324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5
Jun 26 00:42:40 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:40 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:40 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-935b400c-ab27-4722-b326-f391bbf4eda5" returned: 0 in 0.641s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:40 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-935b400c-ab27-4722-b326-f391bbf4eda5" released by "delete_volume" :: held 1.413s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Created reservations ['159f46e7-b9bd-46b1-9f60-67408830b38b', '705112e5-88a0-45ce-8d36-a7a5ee97a97d', 'ae9620ea-f7b1-4d16-8de3-13efab28b14a', 'e7dd32c3-ef9e-4bd7-9734-a8ca618bead2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:41 devstack sudo[115327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:41 devstack sudo[115327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:41 devstack sudo[115327]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.638s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:41 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Deleted volume successfully.
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-57447581-c11b-4ad5-9983-42de2ec24bab-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5a1e9957-6b90-481f-ba6a-b1a2003349ee tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-935b400c-ab27-4722-b326-f391bbf4eda5-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-57447581-c11b-4ad5-9983-42de2ec24bab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "cinder-quobyte-57447581-c11b-4ad5-9983-42de2ec24bab" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-57447581-c11b-4ad5-9983-42de2ec24bab" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[76666c9a-3c1f-4fb7-a58a-a4cad4d8a699]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:42:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:41 devstack sudo[115330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab
Jun 26 00:42:41 devstack sudo[115330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:42 devstack sudo[115330]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab" returned: 0 in 0.738s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:42 devstack sudo[115335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab
Jun 26 00:42:42 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:43 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-57447581-c11b-4ad5-9983-42de2ec24bab" returned: 0 in 0.619s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-quobyte-57447581-c11b-4ad5-9983-42de2ec24bab" released by "delete_volume" :: held 1.394s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Created reservations ['ee6c717c-c8ab-4a67-aed7-9442bc252cb5', '224ec33d-9dc1-4132-b619-47f433869b2d', 'dbaea233-a6e2-4cc0-8177-a07333b19007', '56908fb6-4a9c-4a3c-8213-b13904ddb516'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:43 devstack sudo[115338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:42:43 devstack sudo[115338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:43 devstack sudo[115338]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.630s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:42:43 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Deleted volume successfully.
Jun 26 00:42:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7de137af-e426-4d29-bb78-c7202227e429 tempest-CreateVolumesFromImageTest-1290494339 None] Lock "cinder-57447581-c11b-4ad5-9983-42de2ec24bab-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:42:53 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=54,cinder:UPDATE=67,cinder:INSERT=13,cinder:DELETE=6 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:42:53 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=26,cinder:UPDATE=59,cinder:DELETE=6,cinder:INSERT=15 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:42:55 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (bcb1769d-51b6-4c8a-aa6a-368aa67704ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70298f0c-7962-4c54-b06d-476a738a0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70298f0c-7962-4c54-b06d-476a738a0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055711682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8144754f-d7d3-4833-8d14-72de02e91bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:56Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1aab13-9558-49d9-8dd0-037d43c70d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1aab13-9558-49d9-8dd0-037d43c70d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f49c57-07a3-4059-b2ce-4b12ca88e3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f49c57-07a3-4059-b2ce-4b12ca88e3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8144754f-d7d3-4833-8d14-72de02e91bbe', 'volume_name': 'volume-8144754f-d7d3-4833-8d14-72de02e91bbe', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3695ec61-59fb-4c21-b885-e0b48b496022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3695ec61-59fb-4c21-b885-e0b48b496022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5321e935-9135-41ff-8ea6-ef27e10e419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Volume 8144754f-d7d3-4833-8d14-72de02e91bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8144754f-d7d3-4833-8d14-72de02e91bbe', 'volume_size': 1}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055711682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8144754f-d7d3-4833-8d14-72de02e91bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:56Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Creating volume 8144754f-d7d3-4833-8d14-72de02e91bbe {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:56 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:56 devstack sudo[115384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe 1073741824
Jun 26 00:42:56 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (f27d1b38-1617-4c24-b3dd-585bcf801ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec36c94a-61a2-49c2-8745-f9923cf18745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (241116ff-8828-4813-a64b-76aebd28a1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8648be41-14fb-4efc-b8cc-d9aa86268c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec36c94a-61a2-49c2-8745-f9923cf18745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-343593243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485dfc78-bbeb-44dd-b666-6b646bcc29cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:56Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca738be-ec58-402f-a736-c65ed427d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca738be-ec58-402f-a736-c65ed427d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70798cbe-bdb6-4ef1-8f90-2d44642085b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70798cbe-bdb6-4ef1-8f90-2d44642085b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485dfc78-bbeb-44dd-b666-6b646bcc29cb', 'volume_name': 'volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d050c78-2364-444f-9c7a-ce125f7035b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d050c78-2364-444f-9c7a-ce125f7035b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b003ca3-c550-42a3-93da-b1300647f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume 485dfc78-bbeb-44dd-b666-6b646bcc29cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb', 'volume_size': 1}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8648be41-14fb-4efc-b8cc-d9aa86268c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912954631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdfe10c-80d9-4d93-9f59-479d0e1d9949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:56Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ecd34d-2d86-4e47-a150-c1aafaf430d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ecd34d-2d86-4e47-a150-c1aafaf430d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58320f-1272-41ce-bcdd-3c7a5d65fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58320f-1272-41ce-bcdd-3c7a5d65fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdfe10c-80d9-4d93-9f59-479d0e1d9949', 'volume_name': 'volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11109de9-06c0-4968-bcb0-a6a6c8709dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11109de9-06c0-4968-bcb0-a6a6c8709dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cedad5-3b6e-4fc2-bd9d-696ffe0023ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:56 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Volume 7cdfe10c-80d9-4d93-9f59-479d0e1d9949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949', 'volume_size': 1}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Flow 'volume_create_manager' (2d7b7b8d-be6e-4b06-81e7-5aa52828f323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:56 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611224fc-1360-4afc-ae6b-509b69d28d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611224fc-1360-4afc-ae6b-509b69d28d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144368837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cd83ff-fcae-4f06-a0e9-f5754deee13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c59fc99aa934b13be04bf3678e92480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:57Z,use_quota=True,user_id='3c001dd496174aeeb76c75f9cb08512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5bdb9a-9991-4d34-9d10-7a817872d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5bdb9a-9991-4d34-9d10-7a817872d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdd7950-a632-46e4-a8f6-77a7b048fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdd7950-a632-46e4-a8f6-77a7b048fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cd83ff-fcae-4f06-a0e9-f5754deee13b', 'volume_name': 'volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c9a699-35d4-490d-b0e5-4def19b1e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c9a699-35d4-490d-b0e5-4def19b1e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238c38ea-92ff-4eac-be64-a27a502e0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Volume 42cd83ff-fcae-4f06-a0e9-f5754deee13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b', 'volume_size': 1}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (0c4d31e7-0d5f-4812-aa9e-14347e7bcdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe15dbbd-326a-4750-81af-313b21bdb20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe15dbbd-326a-4750-81af-313b21bdb20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716575037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee7db43-87ea-4f15-b7eb-3f0332afd50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:57Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef61015-e3b1-43e4-a597-b81d45869a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef61015-e3b1-43e4-a597-b81d45869a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ec0867-b8ac-4ce9-96d2-5d8e84bcec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ec0867-b8ac-4ce9-96d2-5d8e84bcec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee7db43-87ea-4f15-b7eb-3f0332afd50d', 'volume_name': 'volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a81a42b-eaa3-4a5e-8c76-d67e7e8d1fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a81a42b-eaa3-4a5e-8c76-d67e7e8d1fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0f3b8c-1db9-4ee5-94a4-df18385e2159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Volume 4ee7db43-87ea-4f15-b7eb-3f0332afd50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d', 'volume_size': 1}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:57 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe 1073741824" returned: 0 in 1.237s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (3cbc8d2e-f029-43ec-8a9d-76cac2426a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c14772a-f0e6-49d9-b38e-8aa97276eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c14772a-f0e6-49d9-b38e-8aa97276eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410994333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:57Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc88b2c-3b43-443c-8529-4568aa3f8917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc88b2c-3b43-443c-8529-4568aa3f8917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d4ccec-1e5d-42f7-8b5f-26b08ca67de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d4ccec-1e5d-42f7-8b5f-26b08ca67de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d', 'volume_name': 'volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90182138-874c-41fd-9062-7e7d82dc1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90182138-874c-41fd-9062-7e7d82dc1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974bc448-0d1a-403e-8dd1-76f43de8a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Volume c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d', 'volume_size': 1}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:57 devstack sudo[115390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe
Jun 26 00:42:57 devstack sudo[115390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (48d902be-b963-45fa-92aa-c5e244191170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd491ab-fd61-4114-b121-af1e74ceae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd491ab-fd61-4114-b121-af1e74ceae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029182975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100bebe4-bafe-496b-b6a7-d03a60e700ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:58Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bb48b1-7cc7-48c0-ba5d-6dbcfe93042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bb48b1-7cc7-48c0-ba5d-6dbcfe93042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095115c8-efe4-4eaa-9337-7282bf4014b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095115c8-efe4-4eaa-9337-7282bf4014b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100bebe4-bafe-496b-b6a7-d03a60e700ee', 'volume_name': 'volume-100bebe4-bafe-496b-b6a7-d03a60e700ee', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4454e1a8-2fb9-4e3a-9128-7b71713fc8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4454e1a8-2fb9-4e3a-9128-7b71713fc8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f89e24-ca87-41f3-815b-971e3c2c87a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Volume 100bebe4-bafe-496b-b6a7-d03a60e700ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100bebe4-bafe-496b-b6a7-d03a60e700ee', 'volume_size': 1}
Jun 26 00:42:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:58 devstack sudo[115390]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe" returned: 0 in 0.701s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-343593243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485dfc78-bbeb-44dd-b666-6b646bcc29cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:56Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Creating volume 485dfc78-bbeb-44dd-b666-6b646bcc29cb {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:58 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5321e935-9135-41ff-8ea6-ef27e10e419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8144754f-d7d3-4833-8d14-72de02e91bbe', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:58 devstack sudo[115393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb 1073741824
Jun 26 00:42:58 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cee24cc-38cd-4a96-aa04-9a8077b7d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:42:58 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Volume volume-8144754f-d7d3-4833-8d14-72de02e91bbe (8144754f-d7d3-4833-8d14-72de02e91bbe): created successfully
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cee24cc-38cd-4a96-aa04-9a8077b7d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:42:58 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (bcb1769d-51b6-4c8a-aa6a-368aa67704ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:42:58 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8d523b4b-c28e-4e03-b70d-2de5d275640e tempest-CreateVolumesFromImageTest-1645681756 None] Created volume successfully.
Jun 26 00:42:59 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb 1073741824" returned: 0 in 0.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:59 devstack sudo[115398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb
Jun 26 00:42:59 devstack sudo[115398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:59 devstack sudo[115398]: pam_unix(sudo:session): session closed for user root
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb" returned: 0 in 0.688s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912954631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdfe10c-80d9-4d93-9f59-479d0e1d9949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:56Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Creating volume 7cdfe10c-80d9-4d93-9f59-479d0e1d9949 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:42:59 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:42:59 devstack sudo[115401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 1073741824
Jun 26 00:42:59 devstack sudo[115401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:42:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b003ca3-c550-42a3-93da-b1300647f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efed8717-f69e-4e09-a055-a15ae77c425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb (485dfc78-bbeb-44dd-b666-6b646bcc29cb): created successfully
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efed8717-f69e-4e09-a055-a15ae77c425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (f27d1b38-1617-4c24-b3dd-585bcf801ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Flow 'volume_create_manager' (3e83b78a-c0a0-4109-ace0-b1337a6338ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd243588-c2fa-46f5-8902-f7f2eae2618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d49e9a2b-7813-420f-aed5-8410bacdb27d tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created volume successfully.
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd243588-c2fa-46f5-8902-f7f2eae2618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bea9c8b-c791-4138-9a96-ac0149f107c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b080705cf540589046445bb06a42af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:00Z,use_quota=True,user_id='c1a5debbd1384db1951138d2f3bcc596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c502fa-9c00-4f49-8e8e-bafe3e2a7a7a),volume_type_id=62c502fa-9c00-4f49-8e8e-bafe3e2a7a7a)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02456068-8b95-499f-91ba-31121b391d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02456068-8b95-499f-91ba-31121b391d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3575a988-ea57-4554-8531-df0e3e11b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3575a988-ea57-4554-8531-df0e3e11b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bea9c8b-c791-4138-9a96-ac0149f107c0', 'volume_name': 'volume-0bea9c8b-c791-4138-9a96-ac0149f107c0', 'volume_size': 1, 'image_id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a66fa3e0d1b9f0ed4bea0b2d8f199453', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b080705cf540589046445bb06a42af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7361662b314bb7cc3af6740a966ac33646f22815d07cfede93fa12e7e4022eb1a231c91735be655abad03e763a77dd0a9236b5e2cc545988736ac154955abd00', 'id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'created_at': datetime.datetime(2026, 6, 25, 22, 42, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 42, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e244f99ac30>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775cc163-3252-4e64-9246-069cde807242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775cc163-3252-4e64-9246-069cde807242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ab501e-82aa-4817-a39e-9399219120e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Volume 0bea9c8b-c791-4138-9a96-ac0149f107c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bea9c8b-c791-4138-9a96-ac0149f107c0', 'volume_size': 1, 'image_id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a66fa3e0d1b9f0ed4bea0b2d8f199453', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b080705cf540589046445bb06a42af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7361662b314bb7cc3af6740a966ac33646f22815d07cfede93fa12e7e4022eb1a231c91735be655abad03e763a77dd0a9236b5e2cc545988736ac154955abd00', 'id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'created_at': datetime.datetime(2026, 6, 25, 22, 42, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 42, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e244f99ac30>}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Trying to clone 0bea9c8b-c791-4138-9a96-ac0149f107c0 from image 6e1c9a74-ac6c-457e-8544-cf7e3c71014f at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:43:00 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0548df-915b-491c-bc4f-378966d4c68d]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:00 devstack sudo[115406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD
Jun 26 00:43:00 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:00 devstack sudo[115401]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 1073741824" returned: 0 in 0.967s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:01 devstack sudo[115408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:01 devstack sudo[115408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:01 devstack sudo[115409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949
Jun 26 00:43:01 devstack sudo[115409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (a52f04d8-5659-4e0b-9ff5-e3310585143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec21592-0340-48d3-b2ec-ceae7254ce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec21592-0340-48d3-b2ec-ceae7254ce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73426664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2631f3c9-f2f3-492f-bbde-4e8e34e75274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:01Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1223a4e3-0447-4d4e-965c-2d191dce27e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1223a4e3-0447-4d4e-965c-2d191dce27e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847b3f1b-ed39-4c00-956c-1e4ff8b386df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847b3f1b-ed39-4c00-956c-1e4ff8b386df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2631f3c9-f2f3-492f-bbde-4e8e34e75274', 'volume_name': 'volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea873fc9-61ae-47a2-a42f-06506b652cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea873fc9-61ae-47a2-a42f-06506b652cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7570099-10ad-4663-ab1f-4c9f0dc0550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume 2631f3c9-f2f3-492f-bbde-4e8e34e75274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274', 'volume_size': 1}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (90887c7b-6257-4fe3-9281-1afe98f1bcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf8154d-1534-4d9c-88cc-29d2452c2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf8154d-1534-4d9c-88cc-29d2452c2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1159414774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95064f8b-7a08-442c-a8d9-24a03dacfd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:02Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e610887-f40f-4bc8-90ed-8abd59c62406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e610887-f40f-4bc8-90ed-8abd59c62406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f70fdec-99ca-4cf1-a981-12533c637460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f70fdec-99ca-4cf1-a981-12533c637460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95064f8b-7a08-442c-a8d9-24a03dacfd24', 'volume_name': 'volume-95064f8b-7a08-442c-a8d9-24a03dacfd24', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f17b167-06c7-4e6c-a943-71ef8f148cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f17b167-06c7-4e6c-a943-71ef8f148cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a436eaec-e58e-4c27-a14f-24df24d85f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:01 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume 95064f8b-7a08-442c-a8d9-24a03dacfd24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95064f8b-7a08-442c-a8d9-24a03dacfd24', 'volume_size': 1}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD" returned: 0 in 1.069s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:01 devstack sudo[115414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD
Jun 26 00:43:01 devstack sudo[115414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:02 devstack sudo[115409]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949" returned: 0 in 0.962s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.939s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144368837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cd83ff-fcae-4f06-a0e9-f5754deee13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c59fc99aa934b13be04bf3678e92480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:57Z,use_quota=True,user_id='3c001dd496174aeeb76c75f9cb08512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Creating volume 42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.129s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:02 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cedad5-3b6e-4fc2-bd9d-696ffe0023ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack sudo[115420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b 1073741824
Jun 26 00:43:02 devstack sudo[115420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f8cfcd-2142-429b-a07c-c26551008c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Volume volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 (7cdfe10c-80d9-4d93-9f59-479d0e1d9949): created successfully
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f8cfcd-2142-429b-a07c-c26551008c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack sudo[115408]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (241116ff-8828-4813-a64b-76aebd28a1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (8bf3278e-bcce-409f-b6ab-38f1ba581c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa0084c-6114-450e-b99b-5a3d6f87951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.303s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:43:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-db8b9554-4d4f-4588-a173-9cf92c276269 tempest-CreateVolumesFromImageTest-1645681756 None] Created volume successfully.
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa0084c-6114-450e-b99b-5a3d6f87951c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121366598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9109b39d-a475-4e52-8eb6-1c055e06e227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:02Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae9f105-1a41-428e-aa28-4d2d3b7ff8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae9f105-1a41-428e-aa28-4d2d3b7ff8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1c2ac0-9d22-4b63-91a5-48fc249fba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1c2ac0-9d22-4b63-91a5-48fc249fba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9109b39d-a475-4e52-8eb6-1c055e06e227', 'volume_name': 'volume-9109b39d-a475-4e52-8eb6-1c055e06e227', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbb5647-e9bd-484f-ae9d-fd87a4039e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbb5647-e9bd-484f-ae9d-fd87a4039e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd9e79b-9737-4fa9-9193-eaa8ab26e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume 9109b39d-a475-4e52-8eb6-1c055e06e227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9109b39d-a475-4e52-8eb6-1c055e06e227', 'volume_size': 1}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (8aea31a3-c9d2-4571-ab8b-10db01686e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:02 devstack sudo[115414]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1285244-d968-4aeb-98f0-2020c0af4b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD" returned: 1 in 0.973s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Temporary image 6e1c9a74-ac6c-457e-8544-cf7e3c71014f is fetched for user c1a5debbd1384db1951138d2f3bcc596. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1285244-d968-4aeb-98f0-2020c0af4b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131925529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:03Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beca5463-ea11-4f84-b80b-72826197aa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beca5463-ea11-4f84-b80b-72826197aa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8589320-b1aa-4880-8b28-ba1c418c1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8589320-b1aa-4880-8b28-ba1c418c1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e', 'volume_name': 'volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c908144-3fb5-4561-bf30-da5bc96ffac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c908144-3fb5-4561-bf30-da5bc96ffac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f324d-141b-402c-8984-952745316c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume 9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e', 'volume_size': 1}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c0ac2-284b-4d56-ab5e-fbe66ab236cc]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:02 devstack sudo[115431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD
Jun 26 00:43:02 devstack sudo[115431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (4501679e-07f1-424d-8038-a6ac2e631016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb8c65c-f911-4e1b-8daf-bc1737ea366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb8c65c-f911-4e1b-8daf-bc1737ea366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239291009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deca9194-fc02-4916-ab7d-e3b080c54912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:03Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e8444-bca4-43fd-a2d0-d254873822f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e8444-bca4-43fd-a2d0-d254873822f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbf5b3e-7edd-429f-8538-88837c6ba826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbf5b3e-7edd-429f-8538-88837c6ba826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deca9194-fc02-4916-ab7d-e3b080c54912', 'volume_name': 'volume-deca9194-fc02-4916-ab7d-e3b080c54912', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606f10cc-543c-4410-be40-644564faf7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606f10cc-543c-4410-be40-644564faf7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a057931-4bb5-45fe-ab91-f3abfbdb3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:03 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume deca9194-fc02-4916-ab7d-e3b080c54912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deca9194-fc02-4916-ab7d-e3b080c54912', 'volume_size': 1}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:03 devstack sudo[115420]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b 1073741824" returned: 0 in 1.192s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:03 devstack sudo[115436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:03 devstack sudo[115436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:03 devstack sudo[115431]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD" returned: 0 in 0.807s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:03 devstack sudo[115440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD
Jun 26 00:43:03 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:04 devstack sudo[115436]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 0.673s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.865s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716575037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee7db43-87ea-4f15-b7eb-3f0332afd50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:57Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Creating volume 4ee7db43-87ea-4f15-b7eb-3f0332afd50d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:04 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:04 devstack sudo[115443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d 1073741824
Jun 26 00:43:04 devstack sudo[115443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238c38ea-92ff-4eac-be64-a27a502e0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ccfbf-1c1a-442a-a098-2f56c05b232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:04 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Volume volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b (42cd83ff-fcae-4f06-a0e9-f5754deee13b): created successfully
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ccfbf-1c1a-442a-a098-2f56c05b232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Flow 'volume_create_manager' (2d7b7b8d-be6e-4b06-81e7-5aa52828f323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0f661cda-f0dc-48ca-92cf-93ebed75bd92 tempest-VolumeDependencyTests-269716937 None] Created volume successfully.
Jun 26 00:43:04 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD" returned: 1 in 0.725s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:04 devstack sudo[115443]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d 1073741824" returned: 0 in 0.872s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:05 devstack sudo[115452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d
Jun 26 00:43:05 devstack sudo[115452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:05 devstack sudo[115452]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d" returned: 0 in 0.643s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.082s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410994333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:57Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Creating volume c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:05 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0f3b8c-1db9-4ee5-94a4-df18385e2159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:05 devstack sudo[115455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d 1073741824
Jun 26 00:43:05 devstack sudo[115455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea14e7b-d6b3-47f2-a4e4-f92e989d7ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:05 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Volume volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d (4ee7db43-87ea-4f15-b7eb-3f0332afd50d): created successfully
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea14e7b-d6b3-47f2-a4e4-f92e989d7ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:05 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (0c4d31e7-0d5f-4812-aa9e-14347e7bcdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-291aa72d-8f4c-4bb1-bdac-08a329867b5b tempest-CreateVolumesFromImageTest-1645681756 None] Created volume successfully.
Jun 26 00:43:06 devstack sudo[115455]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d 1073741824" returned: 0 in 0.802s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:06 devstack sudo[115460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d
Jun 26 00:43:06 devstack sudo[115460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:07 devstack sudo[115460]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d" returned: 0 in 0.640s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.242s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029182975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100bebe4-bafe-496b-b6a7-d03a60e700ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263ec6b14dba401289b6f69e98a40f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:42:58Z,use_quota=True,user_id='977e90e73be245bc9d7b463d246036bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Creating volume 100bebe4-bafe-496b-b6a7-d03a60e700ee {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:07 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:07 devstack sudo[115464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee 1073741824
Jun 26 00:43:07 devstack sudo[115464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974bc448-0d1a-403e-8dd1-76f43de8a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f37678-1b4c-4473-b8c7-7e849716fdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:07 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Volume volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d (c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d): created successfully
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f37678-1b4c-4473-b8c7-7e849716fdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:07 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (3cbc8d2e-f029-43ec-8a9d-76cac2426a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:07 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0564932d-3cec-4b53-9056-fcff0ddf12b5 tempest-CreateVolumesFromImageTest-1645681756 None] Created volume successfully.
Jun 26 00:43:08 devstack sudo[115464]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee 1073741824" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:08 devstack sudo[115469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee
Jun 26 00:43:08 devstack sudo[115469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:08 devstack sudo[115469]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee" returned: 0 in 0.642s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.499s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73426664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2631f3c9-f2f3-492f-bbde-4e8e34e75274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:01Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Creating volume 2631f3c9-f2f3-492f-bbde-4e8e34e75274 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:08 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:08 devstack sudo[115472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 1073741824
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f89e24-ca87-41f3-815b-971e3c2c87a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100bebe4-bafe-496b-b6a7-d03a60e700ee', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:08 devstack sudo[115472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0a4ae5-3694-4ba2-9253-0ea325163123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:08 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Volume volume-100bebe4-bafe-496b-b6a7-d03a60e700ee (100bebe4-bafe-496b-b6a7-d03a60e700ee): created successfully
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0a4ae5-3694-4ba2-9253-0ea325163123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Flow 'volume_create_manager' (48d902be-b963-45fa-92aa-c5e244191170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-07ca4b02-d044-4c8c-906f-f44d06366eab tempest-CreateVolumesFromImageTest-1645681756 None] Created volume successfully.
Jun 26 00:43:09 devstack sudo[115472]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 1073741824" returned: 0 in 0.797s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:09 devstack sudo[115477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274
Jun 26 00:43:09 devstack sudo[115477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-100bebe4-bafe-496b-b6a7-d03a60e700ee-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-100bebe4-bafe-496b-b6a7-d03a60e700ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-quobyte-100bebe4-bafe-496b-b6a7-d03a60e700ee" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-100bebe4-bafe-496b-b6a7-d03a60e700ee" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b85cb46-d016-4dc9-bb17-2eca33410187]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:10 devstack sudo[115479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee
Jun 26 00:43:10 devstack sudo[115479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:10 devstack sudo[115477]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274" returned: 0 in 0.687s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.505s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1159414774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95064f8b-7a08-442c-a8d9-24a03dacfd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:02Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Creating volume 95064f8b-7a08-442c-a8d9-24a03dacfd24 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:10 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:10 devstack sudo[115482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 1073741824
Jun 26 00:43:10 devstack sudo[115482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7570099-10ad-4663-ab1f-4c9f0dc0550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543f8d4a-a2fc-4726-99fe-b5b717501654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:10 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 (2631f3c9-f2f3-492f-bbde-4e8e34e75274): created successfully
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543f8d4a-a2fc-4726-99fe-b5b717501654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (a52f04d8-5659-4e0b-9ff5-e3310585143c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:10 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5b1f5bea-b6bd-42fd-8a8d-ecc5f190c00b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created volume successfully.
Jun 26 00:43:10 devstack sudo[115479]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee" returned: 0 in 0.793s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:10 devstack sudo[115487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee
Jun 26 00:43:10 devstack sudo[115487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:11 devstack sudo[115482]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 1073741824" returned: 0 in 0.895s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:11 devstack sudo[115493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24
Jun 26 00:43:11 devstack sudo[115493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:11 devstack sudo[115487]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-100bebe4-bafe-496b-b6a7-d03a60e700ee" returned: 0 in 0.689s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-100bebe4-bafe-496b-b6a7-d03a60e700ee" released by "delete_volume" :: held 1.524s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Created reservations ['8119e4e7-20d5-40bd-a540-36ec0ec6702e', '180203b1-ad6f-43d3-9b97-1d624c466844', '509535b3-0d16-40f3-9f7f-864934ad60ae', '5e516edc-17d8-4079-b7ca-fade89aba545'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:11 devstack sudo[115496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:11 devstack sudo[115496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:11 devstack sudo[115493]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24" returned: 0 in 0.659s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.413s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121366598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9109b39d-a475-4e52-8eb6-1c055e06e227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:02Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Creating volume 9109b39d-a475-4e52-8eb6-1c055e06e227 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:11 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a436eaec-e58e-4c27-a14f-24df24d85f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95064f8b-7a08-442c-a8d9-24a03dacfd24', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:11 devstack sudo[115499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227 1073741824
Jun 26 00:43:11 devstack sudo[115499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cef595-9bb7-4839-ba76-a1b45c281ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:11 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 (95064f8b-7a08-442c-a8d9-24a03dacfd24): created successfully
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cef595-9bb7-4839-ba76-a1b45c281ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:11 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (90887c7b-6257-4fe3-9281-1afe98f1bcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e2fdad51-0b05-4b71-8d05-d9c258f06e09 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created volume successfully.
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-quobyte-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e31e0-b12a-48e3-91f9-dae78ec572ac]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:12 devstack sudo[115496]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.712s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Deleted volume successfully.
Jun 26 00:43:12 devstack sudo[115502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d
Jun 26 00:43:12 devstack sudo[115502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fc93cd10-bbc8-4fdb-a9c9-8da5dd9201cd tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-100bebe4-bafe-496b-b6a7-d03a60e700ee-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:12 devstack sudo[115499]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227 1073741824" returned: 0 in 0.897s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:12 devstack sudo[115507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227
Jun 26 00:43:12 devstack sudo[115507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:12 devstack sudo[115502]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d" returned: 0 in 0.766s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:12 devstack sudo[115512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d
Jun 26 00:43:12 devstack sudo[115512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:13 devstack sudo[115507]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227" returned: 0 in 0.650s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.678s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131925529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:03Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Creating volume 9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:13 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd9e79b-9737-4fa9-9193-eaa8ab26e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9109b39d-a475-4e52-8eb6-1c055e06e227', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:13 devstack sudo[115515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e 1073741824
Jun 26 00:43:13 devstack sudo[115515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9ceabe-fe25-4df5-9739-8b907c73c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:13 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume volume-9109b39d-a475-4e52-8eb6-1c055e06e227 (9109b39d-a475-4e52-8eb6-1c055e06e227): created successfully
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9ceabe-fe25-4df5-9739-8b907c73c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (8bf3278e-bcce-409f-b6ab-38f1ba581c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-66ac9b88-9ece-421d-9116-58ac46a19750 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created volume successfully.
Jun 26 00:43:13 devstack sudo[115512]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d" returned: 0 in 0.635s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d" released by "delete_volume" :: held 1.445s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Created reservations ['a47fc0aa-d2eb-41a8-b5b6-c1356a16137f', 'a464e09a-e391-433a-8619-c23a9ce7aaa7', 'd05d6b4f-87f3-4311-ad22-fcef2cf2f1ab', '310c4d17-e56d-45e2-964a-b3e1fe8ce2c9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:13 devstack sudo[115518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:13 devstack sudo[115518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:14 devstack sudo[115515]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e 1073741824" returned: 0 in 0.842s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-4ee7db43-87ea-4f15-b7eb-3f0332afd50d-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-4ee7db43-87ea-4f15-b7eb-3f0332afd50d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:14 devstack sudo[115524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e
Jun 26 00:43:14 devstack sudo[115524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-quobyte-4ee7db43-87ea-4f15-b7eb-3f0332afd50d" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:14 devstack sudo[115518]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-4ee7db43-87ea-4f15-b7eb-3f0332afd50d" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.693s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:14 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Deleted volume successfully.
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d83f903-b30d-4153-8eca-f70a292eb289]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-f8268f8a-4aa0-4b02-a68a-70576ed83e61 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-c2599608-f4a7-4f4b-8a94-7d34a0dcfc0d-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:14 devstack sudo[115526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d
Jun 26 00:43:14 devstack sudo[115526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:14 devstack sudo[115524]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e" returned: 0 in 0.655s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.868s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239291009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deca9194-fc02-4916-ab7d-e3b080c54912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef50137a14cb48898c9f9a5029cd6164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:03Z,use_quota=True,user_id='f3bc09e63b7c4913951980d8e0092ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Creating volume deca9194-fc02-4916-ab7d-e3b080c54912 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:15 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f324d-141b-402c-8984-952745316c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bda03b4-46fd-4f3a-9873-86bf10c301b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:15 devstack sudo[115530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912 1073741824
Jun 26 00:43:15 devstack sudo[115530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:15 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e (9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e): created successfully
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bda03b4-46fd-4f3a-9873-86bf10c301b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (8aea31a3-c9d2-4571-ab8b-10db01686e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:15 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8d6894a3-e566-4b21-877d-4cfbbe3d5f99 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created volume successfully.
Jun 26 00:43:15 devstack sudo[115526]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d" returned: 0 in 0.798s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:15 devstack sudo[115535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d
Jun 26 00:43:15 devstack sudo[115535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:15 devstack sudo[115530]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912 1073741824" returned: 0 in 0.832s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:15 devstack sudo[115535]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4ee7db43-87ea-4f15-b7eb-3f0332afd50d" returned: 0 in 0.641s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-4ee7db43-87ea-4f15-b7eb-3f0332afd50d" released by "delete_volume" :: held 1.487s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:15 devstack sudo[115542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912
Jun 26 00:43:15 devstack sudo[115542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:15 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Created reservations ['08f2b6d2-05f0-4c66-937b-1ff0f208d2ec', '23cdb9a2-45d4-4e2a-8342-927706061815', 'ce771ba0-88e5-446b-aad2-7dec6e27f1b5', 'f30b074a-216a-4f01-bb36-df779a8123ab'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:16 devstack sudo[115544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:16 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:16 devstack sudo[115542]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912" returned: 0 in 0.667s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.242s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bea9c8b-c791-4138-9a96-ac0149f107c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b080705cf540589046445bb06a42af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:00Z,use_quota=True,user_id='c1a5debbd1384db1951138d2f3bcc596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c502fa-9c00-4f49-8e8e-bafe3e2a7a7a),volume_type_id=62c502fa-9c00-4f49-8e8e-bafe3e2a7a7a)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Creating volume 0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:16 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-7cdfe10c-80d9-4d93-9f59-479d0e1d9949-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a057931-4bb5-45fe-ab91-f3abfbdb3aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deca9194-fc02-4916-ab7d-e3b080c54912', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:16 devstack sudo[115548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 1073741824
Jun 26 00:43:16 devstack sudo[115548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394d4636-45e4-4a1b-b980-386d828b2cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-7cdfe10c-80d9-4d93-9f59-479d0e1d9949-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:16 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Volume volume-deca9194-fc02-4916-ab7d-e3b080c54912 (deca9194-fc02-4916-ab7d-e3b080c54912): created successfully
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394d4636-45e4-4a1b-b980-386d828b2cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Flow 'volume_create_manager' (4501679e-07f1-424d-8038-a6ac2e631016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-f23d1b5d-f940-4891-8bb7-dd8a61bec864 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created volume successfully.
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-quobyte-7cdfe10c-80d9-4d93-9f59-479d0e1d9949" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:16 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.694s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-7cdfe10c-80d9-4d93-9f59-479d0e1d9949" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Deleted volume successfully.
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6dad36-8fc6-42d5-b5e4-9524093fbc1e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-80eaaf95-0c88-4137-8dab-30e22fb17733 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-4ee7db43-87ea-4f15-b7eb-3f0332afd50d-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:16 devstack sudo[115550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949
Jun 26 00:43:16 devstack sudo[115550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-deca9194-fc02-4916-ab7d-e3b080c54912-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-deca9194-fc02-4916-ab7d-e3b080c54912-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-quobyte-deca9194-fc02-4916-ab7d-e3b080c54912" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-deca9194-fc02-4916-ab7d-e3b080c54912" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[84810598-d4b3-482f-a90f-e03d0735cdf1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:17 devstack sudo[115556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912
Jun 26 00:43:17 devstack sudo[115556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:17 devstack sudo[115548]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 1073741824" returned: 0 in 0.926s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:17 devstack sudo[115550]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949" returned: 0 in 0.798s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:17 devstack sudo[115562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:17 devstack sudo[115562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:17 devstack sudo[115563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949
Jun 26 00:43:17 devstack sudo[115563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:18 devstack sudo[115556]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912" returned: 0 in 0.843s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:18 devstack sudo[115563]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:18 devstack sudo[115562]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 0 in 0.680s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-7cdfe10c-80d9-4d93-9f59-479d0e1d9949" returned: 0 in 0.668s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:18 devstack sudo[115571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912
Jun 26 00:43:18 devstack sudo[115571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.573s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-7cdfe10c-80d9-4d93-9f59-479d0e1d9949" released by "delete_volume" :: held 1.537s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Creating offline snapshot 44913f93-f63a-4761-a8d7-2220eca0570d of volume 42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Attempting download of 6e1c9a74-ac6c-457e-8544-cf7e3c71014f ((None, [{'url': 'file:///opt/stack/data/glance/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'metadata': {}}])) to volume 0bea9c8b-c791-4138-9a96-ac0149f107c0. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb8c09a-9222-4112-9188-81905b9d98aa]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d33126-ae83-4272-b9b5-e887ea5ca683]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Created reservations ['f6252149-3bd1-4af2-9b85-fd1d22aa6c54', '9e8e4593-4e79-4c59-b79e-77cad7fc43be', 'c3951c22-7959-46a4-aa14-f01210e2a316', 'f42f69e4-eb91-439d-8649-4e46a3555ce4'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:18 devstack sudo[115573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:18 devstack sudo[115573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:18 devstack sudo[115576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:18 devstack sudo[115576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:18 devstack sudo[115574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42
Jun 26 00:43:18 devstack sudo[115574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-8144754f-d7d3-4833-8d14-72de02e91bbe-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:18 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-8144754f-d7d3-4833-8d14-72de02e91bbe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "cinder-quobyte-8144754f-d7d3-4833-8d14-72de02e91bbe" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-8144754f-d7d3-4833-8d14-72de02e91bbe" acquired by "delete_volume" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:19 devstack sudo[115571]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-deca9194-fc02-4916-ab7d-e3b080c54912" returned: 0 in 0.862s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-deca9194-fc02-4916-ab7d-e3b080c54912" released by "delete_volume" :: held 1.747s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1ba14-b99c-45ce-ba01-c51641fb2c54]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created reservations ['b87e271c-3a1f-430b-9794-b03a3774f936', 'bec0a4de-2f2b-4723-9839-091975ec11f2', 'bdcb58d5-86c4-4603-9311-692250bbdf7a', 'e8156a6c-8bba-435f-9878-f075e972a0b9'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:19 devstack sudo[115573]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:19 devstack sudo[115584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe
Jun 26 00:43:19 devstack sudo[115584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 0.956s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:19 devstack sudo[115574]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42" returned: 0 in 0.937s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:19 devstack sudo[115589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d 1G
Jun 26 00:43:19 devstack sudo[115589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:19 devstack sudo[115592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:19 devstack sudo[115592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:19 devstack sudo[115576]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.975s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Deleted volume successfully.
Jun 26 00:43:19 devstack sudo[115591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42
Jun 26 00:43:19 devstack sudo[115591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-c5892f2b-c40a-4b15-9022-36fcb7d2f5a5 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-7cdfe10c-80d9-4d93-9f59-479d0e1d9949-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-quobyte-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e" acquired by "delete_volume" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8814ea5-2a5d-4cea-94e3-6510d19e158c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:19 devstack sudo[115595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e
Jun 26 00:43:19 devstack sudo[115595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:20 devstack sudo[115592]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.816s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:20 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Deleted volume successfully.
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-63ca60a4-5046-4c96-a722-3801693f1afa tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-deca9194-fc02-4916-ab7d-e3b080c54912-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:20 devstack sudo[115584]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe" returned: 0 in 1.220s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:20 devstack sudo[115606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe
Jun 26 00:43:20 devstack sudo[115606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:20 devstack sudo[115591]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42" returned: 1 in 1.058s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_enj2mp42' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bf207-4165-434d-8f31-91dc6cae59b6]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:20 devstack sudo[115589]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d 1G" returned: 0 in 1.146s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:20 devstack sudo[115609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d
Jun 26 00:43:20 devstack sudo[115609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:20 devstack sudo[115608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD
Jun 26 00:43:20 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:20 devstack sudo[115595]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e" returned: 0 in 1.120s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:20 devstack sudo[115616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e
Jun 26 00:43:20 devstack sudo[115616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:21 devstack sudo[115606]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8144754f-d7d3-4833-8d14-72de02e91bbe" returned: 0 in 0.737s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-quobyte-8144754f-d7d3-4833-8d14-72de02e91bbe" released by "delete_volume" :: held 2.017s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Created reservations ['a5056c64-9ced-40da-a7d5-a3ca06a1ffd5', '29a5625e-1977-47c8-847f-adabce482d38', 'ca632e20-7219-4ed8-aa5e-85f1ec71f91b', 'cf291dd0-712e-4d16-9425-456acd28c46b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:21 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD" returned: 0 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:21 devstack sudo[115609]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d" returned: 0 in 0.818s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:21 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d is being set with open permissions: ugo+rw
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:21 devstack sudo[115626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d
Jun 26 00:43:21 devstack sudo[115626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:21 devstack sudo[115628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:21 devstack sudo[115628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:21 devstack sudo[115625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD
Jun 26 00:43:21 devstack sudo[115625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:21 devstack sudo[115616]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e" returned: 0 in 0.726s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e" released by "delete_volume" :: held 1.897s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created reservations ['8a33b217-c874-4bfd-bbc2-76e8d5288fe5', '05a2a790-420e-4cf5-827d-e7d1ec76d538', '162e7e5c-f801-4d96-9917-1aee47c2a45f', '2d4e7828-12e1-464a-a27e-5e3b8a331607'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:21 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:21 devstack sudo[115632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:21 devstack sudo[115632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:22 devstack sudo[115626]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d" returned: 0 in 0.768s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:22 devstack sudo[115628]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-9109b39d-a475-4e52-8eb6-1c055e06e227-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.768s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:22 devstack sudo[115639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info
Jun 26 00:43:22 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Deleted volume successfully.
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-9109b39d-a475-4e52-8eb6-1c055e06e227-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:22 devstack sudo[115625]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD" returned: 1 in 0.958s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] 6e1c9a74-ac6c-457e-8544-cf7e3c71014f was raw, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-12cd8d8c-50f7-4aba-b250-d9b1c23acf98 tempest-CreateVolumesFromImageTest-1645681756 None] Lock "cinder-8144754f-d7d3-4833-8d14-72de02e91bbe-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:22 devstack sudo[115641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:22 devstack sudo[115641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-quobyte-9109b39d-a475-4e52-8eb6-1c055e06e227" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-9109b39d-a475-4e52-8eb6-1c055e06e227" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c7a7d-796b-4ca0-aebc-65529e479ba6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:22 devstack sudo[115643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227
Jun 26 00:43:22 devstack sudo[115643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:22 devstack sudo[115632]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.996s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Deleted volume successfully.
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-6c9cd585-60d0-49ae-9e56-62343fa9f839 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-9ef97fad-e0b5-40e7-ba0e-605a27e0cb8e-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:22 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info" returned: 0 in 0.798s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:22 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info is being set with open permissions: ugo+rw
Jun 26 00:43:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:22 devstack sudo[115647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info
Jun 26 00:43:22 devstack sudo[115647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:23 devstack sudo[115643]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227" returned: 0 in 0.997s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:23 devstack sudo[115655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227
Jun 26 00:43:23 devstack sudo[115655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:23 devstack sudo[115641]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 0 in 1.187s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e1c9a74-ac6c-457e-8544-cf7e3c71014f_nub73hv2devstack@QuobyteHD, size 0.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:43:23 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:23 devstack sudo[115657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 1G
Jun 26 00:43:23 devstack sudo[115657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:23 devstack sudo[115647]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.info" returned: 0 in 0.809s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.436s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:23 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-1cb2531e-685a-4f59-b3ad-e09ec4b811f8 tempest-VolumeDependencyTests-269716937 None] Create snapshot completed successfully
Jun 26 00:43:24 devstack sudo[115655]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-9109b39d-a475-4e52-8eb6-1c055e06e227" returned: 0 in 0.768s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-9109b39d-a475-4e52-8eb6-1c055e06e227" released by "delete_volume" :: held 1.833s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created reservations ['e45fa33d-95fe-4fe1-8740-5adba455cde9', '25ecc2fb-b67c-4be2-ae17-18c7adb0b6f1', '7b206640-e82f-448d-ac33-fad73409e8b2', 'bfc49f1f-bd53-4ed5-8f2a-49a0ea0d9c90'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:24 devstack sudo[115657]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 1G" returned: 0 in 0.884s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:24 devstack sudo[115665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:24 devstack sudo[115665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[414c05bc-41fe-4369-8ce9-504c9355cb4e]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-95064f8b-7a08-442c-a8d9-24a03dacfd24-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-95064f8b-7a08-442c-a8d9-24a03dacfd24-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:24 devstack sudo[115667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:24 devstack sudo[115667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-quobyte-95064f8b-7a08-442c-a8d9-24a03dacfd24" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-95064f8b-7a08-442c-a8d9-24a03dacfd24" acquired by "delete_volume" :: waited 0.033s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1333b21e-8d44-4b70-9607-f68b1f10e1db]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:24 devstack sudo[115670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24
Jun 26 00:43:24 devstack sudo[115670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:25 devstack sudo[115665]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.914s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:25 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Deleted volume successfully.
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-fad5b117-c08a-4520-b668-68701fd65e6b tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-9109b39d-a475-4e52-8eb6-1c055e06e227-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Flow 'volume_create_manager' (5ca69e40-f1b9-4269-bb58-fa0ea0b2c026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7010292c-0ba2-4266-a029-722185ca4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7010292c-0ba2-4266-a029-722185ca4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375158432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df1bc6d-5887-445f-a9e5-833d6d995b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c59fc99aa934b13be04bf3678e92480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44913f93-f63a-4761-a8d7-2220eca0570d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:25Z,use_quota=True,user_id='3c001dd496174aeeb76c75f9cb08512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a8c67-2cec-4bcd-a086-26e2633ac3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a8c67-2cec-4bcd-a086-26e2633ac3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc86dc0-81ec-4d9c-a54c-f9d2345b3c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc86dc0-81ec-4d9c-a54c-f9d2345b3c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4df1bc6d-5887-445f-a9e5-833d6d995b18', 'volume_name': 'volume-4df1bc6d-5887-445f-a9e5-833d6d995b18', 'volume_size': 1, 'snapshot_id': '44913f93-f63a-4761-a8d7-2220eca0570d'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c0dc6e-8708-487b-8e22-34f5e5160449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c0dc6e-8708-487b-8e22-34f5e5160449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d646bb-2356-45e4-b800-dce9967921c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:25 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Volume 4df1bc6d-5887-445f-a9e5-833d6d995b18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4df1bc6d-5887-445f-a9e5-833d6d995b18', 'volume_size': 1, 'snapshot_id': '44913f93-f63a-4761-a8d7-2220eca0570d'}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-quobyte-44913f93-f63a-4761-a8d7-2220eca0570d-4df1bc6d-5887-445f-a9e5-833d6d995b18" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:25 devstack sudo[115667]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-44913f93-f63a-4761-a8d7-2220eca0570d-4df1bc6d-5887-445f-a9e5-833d6d995b18" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Creating volume 4df1bc6d-5887-445f-a9e5-833d6d995b18 from snapshot 44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-quobyte-4df1bc6d-5887-445f-a9e5-833d6d995b18" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 0 in 1.190s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-4df1bc6d-5887-445f-a9e5-833d6d995b18" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] snapshot: 44913f93-f63a-4761-a8d7-2220eca0570d, volume: 4df1bc6d-5887-445f-a9e5-833d6d995b18,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ad3beb-4505-4ab3-bdb2-5d9188cdc274]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:25 devstack sudo[115678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:25 devstack sudo[115678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:25 devstack sudo[115670]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24" returned: 0 in 1.051s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:25 devstack sudo[115681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24
Jun 26 00:43:25 devstack sudo[115681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:25 devstack sudo[115679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d
Jun 26 00:43:25 devstack sudo[115679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:26 devstack sudo[115681]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-95064f8b-7a08-442c-a8d9-24a03dacfd24" returned: 0 in 0.873s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:26 devstack sudo[115678]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 1 in 1.063s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Downloaded image 6e1c9a74-ac6c-457e-8544-cf7e3c71014f ((None, [{'url': 'file:///opt/stack/data/glance/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'metadata': {}}])) to volume 0bea9c8b-c791-4138-9a96-ac0149f107c0 successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Temporary image 6e1c9a74-ac6c-457e-8544-cf7e3c71014f for user c1a5debbd1384db1951138d2f3bcc596 is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Marking volume 0bea9c8b-c791-4138-9a96-ac0149f107c0 as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-95064f8b-7a08-442c-a8d9-24a03dacfd24" released by "delete_volume" :: held 2.001s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Copying metadata from image 6e1c9a74-ac6c-457e-8544-cf7e3c71014f to 0bea9c8b-c791-4138-9a96-ac0149f107c0. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Creating volume glance metadata for volume 0bea9c8b-c791-4138-9a96-ac0149f107c0 backed by image 6e1c9a74-ac6c-457e-8544-cf7e3c71014f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a66fa3e0d1b9f0ed4bea0b2d8f199453', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:43:26 devstack sudo[115679]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d" returned: 0 in 1.057s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created reservations ['32554bdb-4749-4f30-93bd-3b76440495e8', 'c1c32a3b-0fdd-43cb-96cc-1a118119717a', 'de37f4e6-3d01-4af1-b192-65889807b370', '00e892ee-f19b-47eb-8c08-6b1270ce1649'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1583303-a2af-415f-a5c1-6f2bed190ddb]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ab501e-82aa-4817-a39e-9399219120e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bea9c8b-c791-4138-9a96-ac0149f107c0', 'volume_size': 1, 'image_id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a66fa3e0d1b9f0ed4bea0b2d8f199453', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b080705cf540589046445bb06a42af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7361662b314bb7cc3af6740a966ac33646f22815d07cfede93fa12e7e4022eb1a231c91735be655abad03e763a77dd0a9236b5e2cc545988736ac154955abd00', 'id': '6e1c9a74-ac6c-457e-8544-cf7e3c71014f', 'created_at': datetime.datetime(2026, 6, 25, 22, 42, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 42, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e1c9a74-ac6c-457e-8544-cf7e3c71014f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e244f99ac30>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29cbc88-cd43-4e20-ba41-43893d9e7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Volume volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 (0bea9c8b-c791-4138-9a96-ac0149f107c0): created successfully
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29cbc88-cd43-4e20-ba41-43893d9e7611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Flow 'volume_create_manager' (3e83b78a-c0a0-4109-ace0-b1337a6338ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7d89b615-d0c6-4d26-9ce4-558f5a5b2d0d tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Created volume successfully.
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:26 devstack sudo[115692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:26 devstack sudo[115692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:26 devstack sudo[115693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:26 devstack sudo[115693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Acquiring lock "cinder-0bea9c8b-c791-4138-9a96-ac0149f107c0-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "cinder-0bea9c8b-c791-4138-9a96-ac0149f107c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Acquiring lock "cinder-quobyte-0bea9c8b-c791-4138-9a96-ac0149f107c0" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:27 devstack sudo[115693]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "cinder-quobyte-0bea9c8b-c791-4138-9a96-ac0149f107c0" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:27 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Deleted volume successfully.
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-00220968-3f34-4545-885a-d830a8bfc26e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-95064f8b-7a08-442c-a8d9-24a03dacfd24-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:27 devstack sudo[115692]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 1.021s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaad74f-d056-4bdb-9a67-e55d51341484]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:27 devstack sudo[115700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18
Jun 26 00:43:27 devstack sudo[115700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-2631f3c9-f2f3-492f-bbde-4e8e34e75274-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-2631f3c9-f2f3-492f-bbde-4e8e34e75274-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:27 devstack sudo[115701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:27 devstack sudo[115701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-quobyte-2631f3c9-f2f3-492f-bbde-4e8e34e75274" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-2631f3c9-f2f3-492f-bbde-4e8e34e75274" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[14703a0a-0fb8-4b01-b13a-4217a10136e5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:28 devstack sudo[115704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274
Jun 26 00:43:28 devstack sudo[115704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:28 devstack sudo[115701]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 0 in 0.985s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:28 devstack sudo[115718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:28 devstack sudo[115718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:29 devstack sudo[115704]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274" returned: 0 in 1.148s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:29 devstack sudo[115723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274
Jun 26 00:43:29 devstack sudo[115723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:31 devstack sudo[115718]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 1 in 2.402s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:31 devstack sudo[115723]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-2631f3c9-f2f3-492f-bbde-4e8e34e75274" returned: 0 in 2.091s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:31 devstack sudo[115730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0
Jun 26 00:43:31 devstack sudo[115730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-2631f3c9-f2f3-492f-bbde-4e8e34e75274" released by "delete_volume" :: held 3.312s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created reservations ['8c6f5de1-7112-423a-9d0d-94013dad55b0', '77dc5689-88bc-490d-960f-6e65573ee436', '6912b67a-5c86-4e76-b563-f5a3c6c6244f', '9d12504d-7348-4530-871e-0112e274ac71'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:31 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:31 devstack sudo[115732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:31 devstack sudo[115732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-485dfc78-bbeb-44dd-b666-6b646bcc29cb-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-485dfc78-bbeb-44dd-b666-6b646bcc29cb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "cinder-quobyte-485dfc78-bbeb-44dd-b666-6b646bcc29cb" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-485dfc78-bbeb-44dd-b666-6b646bcc29cb" acquired by "delete_volume" :: waited 0.080s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:33 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750d2aa-5f44-4e24-b6de-9b115c779887]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:33 devstack sudo[115769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb
Jun 26 00:43:33 devstack sudo[115769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:33 devstack sudo[115730]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-0bea9c8b-c791-4138-9a96-ac0149f107c0" returned: 0 in 2.546s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "cinder-quobyte-0bea9c8b-c791-4138-9a96-ac0149f107c0" released by "delete_volume" :: held 6.124s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:33 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Created reservations ['e338c0fb-296f-4916-8cc0-f8ecbab086fb', 'e5771c87-f665-47cc-89ed-3a11a79afa33', '80945a73-c331-4dd5-a5cc-cef7f4686d48', '8c6f438c-64ba-4213-b3a1-4980f40adb38'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:34 devstack sudo[115732]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 2.382s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Deleted volume successfully.
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d20721b3-7758-428a-8a19-341894782d6e tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-2631f3c9-f2f3-492f-bbde-4e8e34e75274-delete_volume" released by "delete_volume" :: held 6.385s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:34 devstack sudo[115772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:34 devstack sudo[115772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18" returned: 0 in 6.797s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3cf81-3823-43b6-b7f8-1ec0131617ad]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:34 devstack sudo[115777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:34 devstack sudo[115777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:35 devstack sudo[115769]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb" returned: 0 in 1.965s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:35 devstack sudo[115782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb
Jun 26 00:43:35 devstack sudo[115782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:35 devstack sudo[115772]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.101s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:35 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:35 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Deleted volume successfully.
Jun 26 00:43:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-2c995c93-f703-4bdd-bcae-2ef535585d79 tempest-VolumeAndVolumeTypeFromImageTest-265339064 None] Lock "cinder-0bea9c8b-c791-4138-9a96-ac0149f107c0-delete_volume" released by "delete_volume" :: held 7.931s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:35 devstack sudo[115782]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-485dfc78-bbeb-44dd-b666-6b646bcc29cb" returned: 0 in 0.944s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-quobyte-485dfc78-bbeb-44dd-b666-6b646bcc29cb" released by "delete_volume" :: held 3.077s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:36 devstack sudo[115777]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 1.597s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:43:36 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Converted 1024.00 MB image at 150.63 MB/s
Jun 26 00:43:36 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 is being set with open permissions: ugo+rw
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Created reservations ['df87d02b-8954-4f6c-9cd6-b8e2faa558a6', '7cf02b69-0154-4b70-9ca6-a949ce79b7ef', '49ae9c8d-1326-4f32-91a5-031a8f77cfc0', '618008a4-ae7e-4a50-85e6-495255f7f6bf'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:36 devstack sudo[115789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18
Jun 26 00:43:36 devstack sudo[115789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:36 devstack sudo[115791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:36 devstack sudo[115791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:37 devstack sudo[115789]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18" returned: 0 in 0.986s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-4df1bc6d-5887-445f-a9e5-833d6d995b18" released by "_copy_volume_from_snapshot" :: held 11.615s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-44913f93-f63a-4761-a8d7-2220eca0570d-4df1bc6d-5887-445f-a9e5-833d6d995b18" released by "_create_volume_from_snapshot" :: held 11.658s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.679s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d646bb-2356-45e4-b800-dce9967921c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df1bc6d-5887-445f-a9e5-833d6d995b18', 'volume_size': 1, 'snapshot_id': '44913f93-f63a-4761-a8d7-2220eca0570d'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803ad8c0-35e8-4833-af4b-8fb1511d7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:37 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Volume volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 (4df1bc6d-5887-445f-a9e5-833d6d995b18): created successfully
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803ad8c0-35e8-4833-af4b-8fb1511d7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Flow 'volume_create_manager' (5ca69e40-f1b9-4269-bb58-fa0ea0b2c026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-05beca68-fadd-4136-9efe-c43ceec0b6d2 tempest-VolumeDependencyTests-269716937 None] Created volume successfully.
Jun 26 00:43:37 devstack sudo[115791]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 1.073s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:37 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Deleted volume successfully.
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-902d7bbd-8098-4201-b0fd-58617046bce2 tempest-CreateVolumesFromSourceVolumeTest-614970187 None] Lock "cinder-485dfc78-bbeb-44dd-b666-6b646bcc29cb-delete_volume" released by "delete_volume" :: held 4.700s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-44913f93-f63a-4761-a8d7-2220eca0570d-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Lock "cinder-44913f93-f63a-4761-a8d7-2220eca0570d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-quobyte-42cd83ff-fcae-4f06-a0e9-f5754deee13b" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-42cd83ff-fcae-4f06-a0e9-f5754deee13b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-quobyte-44913f93-f63a-4761-a8d7-2220eca0570d" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-44913f93-f63a-4761-a8d7-2220eca0570d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Deleting offline snapshot 44913f93-f63a-4761-a8d7-2220eca0570d of volume 42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] snapshot_file for this snap is: volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb548b-a4eb-4158-893d-d3898be5d213]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:37 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:38 devstack sudo[115795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d
Jun 26 00:43:38 devstack sudo[115795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:38 devstack sudo[115795]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d" returned: 0 in 0.960s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:38 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:43:38 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb23fe-ce40-4fe2-b5d6-5807ad1186a6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:38 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:38 devstack sudo[115800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:38 devstack sudo[115800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:39 devstack sudo[115800]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 1.154s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:39 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:40 devstack sudo[115805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d
Jun 26 00:43:40 devstack sudo[115805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:41 devstack sudo[115805]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d" returned: 0 in 1.015s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:41 devstack sudo[115810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d
Jun 26 00:43:41 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:41 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b.44913f93-f63a-4761-a8d7-2220eca0570d" returned: 0 in 0.778s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-44913f93-f63a-4761-a8d7-2220eca0570d" released by "_delete_snapshot" :: held 4.093s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-42cd83ff-fcae-4f06-a0e9-f5754deee13b" released by "delete_snapshot" :: held 4.124s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (c399341b-ebaf-4c92-bd9b-3c18fcf0d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefd62d0-3820-4b74-b7e4-cf1050856347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefd62d0-3820-4b74-b7e4-cf1050856347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903618336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56db8dcd-6ba3-4109-960c-d06edeed69a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:42Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c67362f-ec34-42ef-be77-0bd541bfdd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:41 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c67362f-ec34-42ef-be77-0bd541bfdd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a470f6de-ccec-4e72-b1af-f2584a1db174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a470f6de-ccec-4e72-b1af-f2584a1db174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56db8dcd-6ba3-4109-960c-d06edeed69a1', 'volume_name': 'volume-56db8dcd-6ba3-4109-960c-d06edeed69a1', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e22dd7-eb96-4b77-b4cc-d3380e5cac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e22dd7-eb96-4b77-b4cc-d3380e5cac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f85ad9-673d-43a1-bb03-f5642887ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:42 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume 56db8dcd-6ba3-4109-960c-d06edeed69a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56db8dcd-6ba3-4109-960c-d06edeed69a1', 'volume_size': 1}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903618336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56db8dcd-6ba3-4109-960c-d06edeed69a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:42Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating volume 56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:42 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:42 devstack sudo[115813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 1073741824
Jun 26 00:43:42 devstack sudo[115813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Created reservations ['9bc1a894-b473-4052-82cd-fd7f7ee97792', '8152d449-378f-4551-88ee-483b016303fb', 'd20b6da0-5fde-476a-941d-0941efe42703', '5d8b7d17-af4e-42df-a630-decc4815f130'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:42 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Delete snapshot completed successfully.
Jun 26 00:43:42 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7c23ec37-cb36-4d71-8cd1-fed472856f2f tempest-VolumeDependencyTests-269716937 None] Lock "cinder-44913f93-f63a-4761-a8d7-2220eca0570d-delete_snapshot" released by "delete_snapshot" :: held 4.534s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-42cd83ff-fcae-4f06-a0e9-f5754deee13b-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-42cd83ff-fcae-4f06-a0e9-f5754deee13b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-quobyte-42cd83ff-fcae-4f06-a0e9-f5754deee13b" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-42cd83ff-fcae-4f06-a0e9-f5754deee13b" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[db85a6e6-f4cd-4b5a-9bf3-377e1799caf4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:43 devstack sudo[115813]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 1073741824" returned: 0 in 1.272s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:43 devstack sudo[115819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:43 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:43 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:43 devstack sudo[115821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1
Jun 26 00:43:43 devstack sudo[115821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:44 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 0.915s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:44 devstack sudo[115828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b
Jun 26 00:43:44 devstack sudo[115828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:44 devstack sudo[115821]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1" returned: 0 in 0.829s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f85ad9-673d-43a1-bb03-f5642887ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56db8dcd-6ba3-4109-960c-d06edeed69a1', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639cf528-6d5e-4a12-8e56-9e93e203798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:44 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 (56db8dcd-6ba3-4109-960c-d06edeed69a1): created successfully
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639cf528-6d5e-4a12-8e56-9e93e203798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:44 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (c399341b-ebaf-4c92-bd9b-3c18fcf0d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:44 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-905096d2-09f1-4251-9723-0cded8e40c5d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created volume successfully.
Jun 26 00:43:44 devstack sudo[115828]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-42cd83ff-fcae-4f06-a0e9-f5754deee13b" returned: 0 in 0.890s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-42cd83ff-fcae-4f06-a0e9-f5754deee13b" released by "delete_volume" :: held 1.901s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Flow 'volume_create_manager' (c23f2f00-d05a-4add-a03c-4d6881cde81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9c769a-036b-4bf9-a399-351bc47c4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9c769a-036b-4bf9-a399-351bc47c4214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824c63b1-62eb-49b2-a35b-84e22e3ab06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4772a1cf547b9ab9f27b73dd735d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:45Z,use_quota=True,user_id='937513f527634d8ba8570dbe0b42af1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6522de9b-dc70-4210-8d39-5a5b76e828d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6522de9b-dc70-4210-8d39-5a5b76e828d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c0ba8d-d1e7-4754-9f26-310833ec7ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.image.glance [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Creating Keystone auth plugin from conf {{(pid=94563) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Created reservations ['67446b2e-5f50-42ef-b43d-65bb4ec3fba7', 'c5b4bbf4-5f2a-4f13-b34e-c6fff645e5c7', 'b552e8da-db31-42db-90e7-53fd114b51a1', '282b654a-9f50-44bd-8c8a-c43972ebea89'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating offline snapshot 60e7c3f3-77af-4e78-a011-63cf3c949833 of volume 56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:43:45 devstack sudo[115832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:45 devstack sudo[115832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-4df1bc6d-5887-445f-a9e5-833d6d995b18-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184a801-eb19-42cd-915f-6eafe60bd49c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-4df1bc6d-5887-445f-a9e5-833d6d995b18-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "cinder-quobyte-4df1bc6d-5887-445f-a9e5-833d6d995b18" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-4df1bc6d-5887-445f-a9e5-833d6d995b18" acquired by "delete_volume" :: waited 0.020s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b3d31f-5bec-43cf-b96b-4760369e7b4c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:45 devstack sudo[115834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1
Jun 26 00:43:45 devstack sudo[115834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c0ba8d-d1e7-4754-9f26-310833ec7ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '824c63b1-62eb-49b2-a35b-84e22e3ab06c', 'volume_name': 'volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c', 'volume_size': 1, 'image_id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acb371fe-850e-4c61-92a3-074dbfacc8b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '486ae54e88c9936b9fdfe4b894bbf8e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2df4772a1cf547b9ab9f27b73dd735d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10b4e386455efe51265b0a3d67747928b36c92bc2e83e5929522cb0c22e481c1814428bb036c89a67c405cd8f2371718e061463051d2ec0f790f16f96f03c469', 'id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'created_at': datetime.datetime(2026, 6, 25, 22, 43, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 43, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acb371fe-850e-4c61-92a3-074dbfacc8b9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459d2b140>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f3d961-93ad-4959-8bfa-867f80b7abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f3d961-93ad-4959-8bfa-867f80b7abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:45 devstack sudo[115835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18
Jun 26 00:43:45 devstack sudo[115835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1da6a91-4b86-4abf-8bee-8ace1d70d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:45 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Volume 824c63b1-62eb-49b2-a35b-84e22e3ab06c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c', 'volume_size': 1, 'image_id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acb371fe-850e-4c61-92a3-074dbfacc8b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '486ae54e88c9936b9fdfe4b894bbf8e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2df4772a1cf547b9ab9f27b73dd735d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10b4e386455efe51265b0a3d67747928b36c92bc2e83e5929522cb0c22e481c1814428bb036c89a67c405cd8f2371718e061463051d2ec0f790f16f96f03c469', 'id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'created_at': datetime.datetime(2026, 6, 25, 22, 43, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 43, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acb371fe-850e-4c61-92a3-074dbfacc8b9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459d2b140>}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Trying to clone 824c63b1-62eb-49b2-a35b-84e22e3ab06c from image acb371fe-850e-4c61-92a3-074dbfacc8b9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/acb371fe-850e-4c61-92a3-074dbfacc8b9', 'metadata': {}}]). {{(pid=94563) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 00:43:45 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 00:43:45 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ed794-e9df-4d25-9864-c6957f43fc42]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:46 devstack sudo[115839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD
Jun 26 00:43:46 devstack sudo[115839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:46 devstack sudo[115832]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.929s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:46 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Deleted volume successfully.
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-96f6de4e-d0cd-4ac3-b457-eb33aaf3d403 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-42cd83ff-fcae-4f06-a0e9-f5754deee13b-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:46 devstack sudo[115834]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1" returned: 0 in 1.040s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:46 devstack sudo[115844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 1G
Jun 26 00:43:46 devstack sudo[115844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:46 devstack sudo[115835]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18" returned: 0 in 1.276s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:46 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:46 devstack sudo[115849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18
Jun 26 00:43:46 devstack sudo[115849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:47 devstack sudo[115839]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD" returned: 0 in 1.061s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:47 devstack sudo[115857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD
Jun 26 00:43:47 devstack sudo[115857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:47 devstack sudo[115844]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 1G" returned: 0 in 0.911s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:47 devstack sudo[115859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833
Jun 26 00:43:47 devstack sudo[115859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:47 devstack sudo[115849]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-4df1bc6d-5887-445f-a9e5-833d6d995b18" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-quobyte-4df1bc6d-5887-445f-a9e5-833d6d995b18" released by "delete_volume" :: held 2.074s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Created reservations ['4239d7f4-4703-4d46-8304-94c16981d4d4', 'd3b6f7af-1057-460c-a148-fc7b4c3ad2be', '39c4f5f4-78f2-4f2a-a98f-1c59c7a33a7b', '3410b79f-83bd-4cc8-824f-210c3f150511'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:47 devstack sudo[115862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:43:47 devstack sudo[115862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:47 devstack sudo[115857]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD" returned: 1 in 0.887s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:47 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Temporary image acb371fe-850e-4c61-92a3-074dbfacc8b9 is fetched for user 937513f527634d8ba8570dbe0b42af1f. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c8e69-a3ed-48c4-958d-093ed305902f]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:48 devstack sudo[115870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD
Jun 26 00:43:48 devstack sudo[115870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:48 devstack sudo[115859]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833" returned: 0 in 0.924s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:48 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 is being set with open permissions: ugo+rw
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:48 devstack sudo[115872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833
Jun 26 00:43:48 devstack sudo[115872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:48 devstack sudo[115862]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.964s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:43:48 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Deleted volume successfully.
Jun 26 00:43:48 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-5dbabe9e-0942-44d5-b2ad-c7b4c3223438 tempest-VolumeDependencyTests-269716937 None] Lock "cinder-4df1bc6d-5887-445f-a9e5-833d6d995b18-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:43:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833" returned: 0 in 1.022s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:49 devstack sudo[115872]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:49 devstack sudo[115870]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD" returned: 0 in 1.266s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:49 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:49 devstack sudo[115878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info
Jun 26 00:43:49 devstack sudo[115878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:49 devstack sudo[115880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD
Jun 26 00:43:49 devstack sudo[115880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:50 devstack sudo[115878]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:50 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info is being set with open permissions: ugo+rw
Jun 26 00:43:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:50 devstack sudo[115883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info
Jun 26 00:43:50 devstack sudo[115883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:50 devstack sudo[115880]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD" returned: 1 in 1.140s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:50 devstack sudo[115883]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:50 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.info" returned: 0 in 0.783s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.714s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824c63b1-62eb-49b2-a35b-84e22e3ab06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4772a1cf547b9ab9f27b73dd735d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:45Z,use_quota=True,user_id='937513f527634d8ba8570dbe0b42af1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Creating volume 824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:51 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:51 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:51 devstack sudo[115889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c 1073741824
Jun 26 00:43:51 devstack sudo[115889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:51 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-61fbcc03-319f-45e1-90da-4ef6388e0397 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Create snapshot completed successfully
Jun 26 00:43:52 devstack sudo[115889]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c 1073741824" returned: 0 in 0.992s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:52 devstack sudo[115895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:43:52 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (1cb475e5-ebef-4afd-a36d-cc23b8d885ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e68f9-2a38-4b33-bf81-4a36d06f662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e68f9-2a38-4b33-bf81-4a36d06f662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2029098992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f793a5-efb0-4e3a-b626-f64f02513941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:52Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cf68dd-08a4-4bbf-bb9f-9f233713558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cf68dd-08a4-4bbf-bb9f-9f233713558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3998a6-a182-4f26-a436-401664f57480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3998a6-a182-4f26-a436-401664f57480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f793a5-efb0-4e3a-b626-f64f02513941', 'volume_name': 'volume-67f793a5-efb0-4e3a-b626-f64f02513941', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4f52bd-43be-4f51-aa6f-b84023cf6480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4f52bd-43be-4f51-aa6f-b84023cf6480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feda039a-b75d-4cd0-89e9-283a9b841d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:52 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume 67f793a5-efb0-4e3a-b626-f64f02513941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f793a5-efb0-4e3a-b626-f64f02513941', 'volume_size': 1}
Jun 26 00:43:52 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (9ef50b62-75b6-4718-9648-fb1bd062600c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404b9254-d906-48f4-803f-967611597c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404b9254-d906-48f4-803f-967611597c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1491078821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a8abec-bda6-44a4-99d0-c497542ace07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:53Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ff8675-22fe-47fc-843f-bdf74a1c8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ff8675-22fe-47fc-843f-bdf74a1c8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc36129-0b01-43e2-828a-0f7ad2f57cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc36129-0b01-43e2-828a-0f7ad2f57cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a8abec-bda6-44a4-99d0-c497542ace07', 'volume_name': 'volume-d6a8abec-bda6-44a4-99d0-c497542ace07', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6125e6-0be2-4e94-9dcb-292fe2590690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6125e6-0be2-4e94-9dcb-292fe2590690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827a1174-f0e1-4d6c-9d90-88b26c35b651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume d6a8abec-bda6-44a4-99d0-c497542ace07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a8abec-bda6-44a4-99d0-c497542ace07', 'volume_size': 1}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:53 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 0 in 1.237s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2029098992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f793a5-efb0-4e3a-b626-f64f02513941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:52Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating volume 67f793a5-efb0-4e3a-b626-f64f02513941 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:53 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:UPDATE=169,cinder:SELECT=108,cinder:INSERT=43,cinder:DELETE=17 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Attempting download of acb371fe-850e-4c61-92a3-074dbfacc8b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/acb371fe-850e-4c61-92a3-074dbfacc8b9', 'metadata': {}}])) to volume 824c63b1-62eb-49b2-a35b-84e22e3ab06c. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 00:43:53 devstack sudo[115899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941 1073741824
Jun 26 00:43:53 devstack sudo[115899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2c49df-6ef6-4c24-8bd8-927e29632319]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:53 devstack sudo[115901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j
Jun 26 00:43:53 devstack sudo[115901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Flow 'volume_create_manager' (1b38e253-d953-4972-aa13-b9fc76b5a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf82d8e7-4e49-4ee2-9f84-49a498725026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf82d8e7-4e49-4ee2-9f84-49a498725026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8295f928-a645-4858-87c7-2496e5c4d29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae22e9430c04f0698a1741499499502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:54Z,use_quota=True,user_id='e13d8964792e4b4ea34b65044c957871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f9994c-938a-495a-a40e-73703d058854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f9994c-938a-495a-a40e-73703d058854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078b6236-654d-4816-bda7-d2564a13eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:53 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078b6236-654d-4816-bda7-d2564a13eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8295f928-a645-4858-87c7-2496e5c4d29b', 'volume_name': 'volume-8295f928-a645-4858-87c7-2496e5c4d29b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799da83f-7530-4475-b8a1-7d25ff0f7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799da83f-7530-4475-b8a1-7d25ff0f7393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2ab2e7-e990-44af-b834-a9abddcec6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Volume 8295f928-a645-4858-87c7-2496e5c4d29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8295f928-a645-4858-87c7-2496e5c4d29b', 'volume_size': 1}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (21c6cd96-8c9d-4445-a1b6-d573b29dbaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8472038-f216-470d-b463-ecf07a9cb337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=143,cinder:UPDATE=171,cinder:INSERT=45,cinder:DELETE=14 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8472038-f216-470d-b463-ecf07a9cb337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734708905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:54Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333c4a94-6556-40fb-9665-5780a441e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333c4a94-6556-40fb-9665-5780a441e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfe700b-b85c-4d48-af85-6f940c0533c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfe700b-b85c-4d48-af85-6f940c0533c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c', 'volume_name': 'volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948a070e-1b8e-4b8a-b201-e534fa859f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948a070e-1b8e-4b8a-b201-e534fa859f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28946405-8e5b-4bae-9662-441a56dd6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume 36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c', 'volume_size': 1}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (4488e918-c76d-4e87-88d1-ce08ea1fdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d47783d-1caa-492c-8ba8-5329888839ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d47783d-1caa-492c-8ba8-5329888839ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2082354549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96baf245-0bed-45b7-af81-5e8934567ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:54Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c0842c-7d2d-49f2-9223-8c463a80e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c0842c-7d2d-49f2-9223-8c463a80e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65217a3-51e0-47ec-bc27-d03e7d5b5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65217a3-51e0-47ec-bc27-d03e7d5b5098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96baf245-0bed-45b7-af81-5e8934567ddb', 'volume_name': 'volume-96baf245-0bed-45b7-af81-5e8934567ddb', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4c9b58-e8a1-4371-ac1f-389ee9d583dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4c9b58-e8a1-4371-ac1f-389ee9d583dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b70b46-8d3f-4fc4-abf1-2a1028912a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume 96baf245-0bed-45b7-af81-5e8934567ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96baf245-0bed-45b7-af81-5e8934567ddb', 'volume_size': 1}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:54 devstack sudo[115901]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j" returned: 0 in 1.125s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:54 devstack sudo[115899]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (2fd24514-043c-4817-bdda-8842f0c6c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:54 devstack sudo[115911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j
Jun 26 00:43:54 devstack sudo[115911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86550cb-ba70-4864-a389-4843b5907b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941 1073741824" returned: 0 in 1.430s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86550cb-ba70-4864-a389-4843b5907b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054298784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb016fe-c103-4232-93e0-241a6d647f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:55Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafa9e9e-ac97-4473-aaae-1b7e6eb1f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafa9e9e-ac97-4473-aaae-1b7e6eb1f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05a9521-2866-4c5c-81fa-6a542ea890af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05a9521-2866-4c5c-81fa-6a542ea890af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb016fe-c103-4232-93e0-241a6d647f1a', 'volume_name': 'volume-8fb016fe-c103-4232-93e0-241a6d647f1a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82126d05-8720-4df1-b06b-d2743373fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82126d05-8720-4df1-b06b-d2743373fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e26b852-b866-4688-8bd8-fe79bec52ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:54 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume 8fb016fe-c103-4232-93e0-241a6d647f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb016fe-c103-4232-93e0-241a6d647f1a', 'volume_size': 1}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:54 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:54 devstack sudo[115913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941
Jun 26 00:43:54 devstack sudo[115913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:55 devstack sudo[115911]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j" returned: 1 in 0.856s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb371fe-850e-4c61-92a3-074dbfacc8b9_64tszb9j' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b9010-7ab5-4f5b-927e-7f520ff74b92]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:55 devstack sudo[115919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD
Jun 26 00:43:55 devstack sudo[115919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:55 devstack sudo[115913]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941" returned: 0 in 0.796s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.406s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1491078821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a8abec-bda6-44a4-99d0-c497542ace07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:53Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating volume d6a8abec-bda6-44a4-99d0-c497542ace07 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:55 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feda039a-b75d-4cd0-89e9-283a9b841d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f793a5-efb0-4e3a-b626-f64f02513941', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b735b4-e78f-4816-9148-d63ae5f5a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:55 devstack sudo[115922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07 1073741824
Jun 26 00:43:55 devstack sudo[115922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:55 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume volume-67f793a5-efb0-4e3a-b626-f64f02513941 (67f793a5-efb0-4e3a-b626-f64f02513941): created successfully
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b735b4-e78f-4816-9148-d63ae5f5a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:55 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (1cb475e5-ebef-4afd-a36d-cc23b8d885ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:55 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b5319cdc-613a-4318-8cba-0855d85692b7 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created volume successfully.
Jun 26 00:43:56 devstack sudo[115919]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD" returned: 0 in 1.010s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:56 devstack sudo[115929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD
Jun 26 00:43:56 devstack sudo[115929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:56 devstack sudo[115922]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07 1073741824" returned: 0 in 1.113s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:56 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:56 devstack sudo[115932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07
Jun 26 00:43:56 devstack sudo[115932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:57 devstack sudo[115929]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD" returned: 1 in 0.769s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] acb371fe-850e-4c61-92a3-074dbfacc8b9 was raw, converting to raw {{(pid=94563) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:57 devstack sudo[115937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:43:57 devstack sudo[115937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:43:57 devstack sudo[115932]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Flow 'volume_create_manager' (1ee9ad9e-6e9d-48e2-a0d6-26c6381e48e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a949edee-aa58-4163-ba56-9c31eee51191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07" returned: 0 in 0.753s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.555s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8295f928-a645-4858-87c7-2496e5c4d29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae22e9430c04f0698a1741499499502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:54Z,use_quota=True,user_id='e13d8964792e4b4ea34b65044c957871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Creating volume 8295f928-a645-4858-87c7-2496e5c4d29b {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:57 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a949edee-aa58-4163-ba56-9c31eee51191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1042453709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97421c7c-847c-4f8b-962a-b539bc8e056e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe3d5469e7f45a7bbe048913b2d4cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:58Z,use_quota=True,user_id='acd1e5fca19047d2a875fffd2bcb0d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f686a5-cca2-45a9-9ea8-8de8ad5f8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:57 devstack sudo[115940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b 1073741824
Jun 26 00:43:57 devstack sudo[115940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f686a5-cca2-45a9-9ea8-8de8ad5f8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9916d5f5-9886-4c85-a334-ec40dc7b5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9916d5f5-9886-4c85-a334-ec40dc7b5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97421c7c-847c-4f8b-962a-b539bc8e056e', 'volume_name': 'volume-97421c7c-847c-4f8b-962a-b539bc8e056e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e40d08-02a4-4b09-92fb-63a1b04fc8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e40d08-02a4-4b09-92fb-63a1b04fc8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d58b4d8-f22c-4114-a75a-b770eef210a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Volume 97421c7c-847c-4f8b-962a-b539bc8e056e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97421c7c-847c-4f8b-962a-b539bc8e056e', 'volume_size': 1}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827a1174-f0e1-4d6c-9d90-88b26c35b651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a8abec-bda6-44a4-99d0-c497542ace07', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4d52a5-d2ae-4640-9414-ee484076f58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:57 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume volume-d6a8abec-bda6-44a4-99d0-c497542ace07 (d6a8abec-bda6-44a4-99d0-c497542ace07): created successfully
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4d52a5-d2ae-4640-9414-ee484076f58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:57 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (9ef50b62-75b6-4718-9648-fb1bd062600c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:57 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2dace17f-7455-48f7-8be7-42018c915f98 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created volume successfully.
Jun 26 00:43:58 devstack sudo[115937]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 0 in 0.820s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acb371fe-850e-4c61-92a3-074dbfacc8b9_9d_vmhvedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:43:58 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:58 devstack sudo[115945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c 1G
Jun 26 00:43:58 devstack sudo[115945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:58 devstack sudo[115940]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b 1073741824" returned: 0 in 0.899s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:58 devstack sudo[115950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b
Jun 26 00:43:58 devstack sudo[115950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:58 devstack sudo[115945]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c 1G" returned: 0 in 0.713s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7027327-6243-4231-ae7d-e01a764f2598]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:43:58 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:58 devstack sudo[115955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:43:58 devstack sudo[115955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:59 devstack sudo[115950]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b" returned: 0 in 0.675s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.953s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734708905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:54Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating volume 36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:43:59 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2ab2e7-e990-44af-b834-a9abddcec6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8295f928-a645-4858-87c7-2496e5c4d29b', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:59 devstack sudo[115958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c 1073741824
Jun 26 00:43:59 devstack sudo[115958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0815396-f95b-4a2f-9d27-2b749ed32c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:43:59 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Volume volume-8295f928-a645-4858-87c7-2496e5c4d29b (8295f928-a645-4858-87c7-2496e5c4d29b): created successfully
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0815396-f95b-4a2f-9d27-2b749ed32c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Flow 'volume_create_manager' (1b38e253-d953-4972-aa13-b9fc76b5a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:43:59 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-90e872e0-8802-4ccc-b6ec-af1fb7042c43 tempest-CinderUnicodeTest-1620531701 None] Created volume successfully.
Jun 26 00:43:59 devstack sudo[115955]: pam_unix(sudo:session): session closed for user root
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 0 in 0.758s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:43:59 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:43:59 devstack sudo[115962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:43:59 devstack sudo[115962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:00 devstack sudo[115958]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c 1073741824" returned: 0 in 0.924s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:00 devstack sudo[115967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c
Jun 26 00:44:00 devstack sudo[115967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:00 devstack sudo[115962]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 1 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Downloaded image acb371fe-850e-4c61-92a3-074dbfacc8b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/acb371fe-850e-4c61-92a3-074dbfacc8b9', 'metadata': {}}])) to volume 824c63b1-62eb-49b2-a35b-84e22e3ab06c successfully. {{(pid=94563) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Temporary image acb371fe-850e-4c61-92a3-074dbfacc8b9 for user 937513f527634d8ba8570dbe0b42af1f is deleted. {{(pid=94563) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.volume_utils [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Marking volume 824c63b1-62eb-49b2-a35b-84e22e3ab06c as bootable. {{(pid=94563) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Copying metadata from image acb371fe-850e-4c61-92a3-074dbfacc8b9 to 824c63b1-62eb-49b2-a35b-84e22e3ab06c. {{(pid=94563) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Creating volume glance metadata for volume 824c63b1-62eb-49b2-a35b-84e22e3ab06c backed by image acb371fe-850e-4c61-92a3-074dbfacc8b9 with: {'image_id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '486ae54e88c9936b9fdfe4b894bbf8e1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94563) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Flow 'volume_create_manager' (1ad3c8ea-cd6a-48c0-8c89-71ff7f88cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44641769-6c2c-4aa5-bfb9-10e79912ea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44641769-6c2c-4aa5-bfb9-10e79912ea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:44:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2021982663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704d641e-5201-45e7-a1c0-96ba30e00320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae22e9430c04f0698a1741499499502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:44:01Z,use_quota=True,user_id='e13d8964792e4b4ea34b65044c957871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0b2d66-2087-4226-9b4c-9ff449fd1643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0b2d66-2087-4226-9b4c-9ff449fd1643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0207053-86a8-423d-8fde-b9ba5decc6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0207053-86a8-423d-8fde-b9ba5decc6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704d641e-5201-45e7-a1c0-96ba30e00320', 'volume_name': 'volume-704d641e-5201-45e7-a1c0-96ba30e00320', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c046188-1015-4d86-b555-af71215199fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c046188-1015-4d86-b555-af71215199fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7643b2-06bb-455a-8e41-daf971469dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Volume 704d641e-5201-45e7-a1c0-96ba30e00320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704d641e-5201-45e7-a1c0-96ba30e00320', 'volume_size': 1}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1da6a91-4b86-4abf-8bee-8ace1d70d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c', 'volume_size': 1, 'image_id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acb371fe-850e-4c61-92a3-074dbfacc8b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '486ae54e88c9936b9fdfe4b894bbf8e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2df4772a1cf547b9ab9f27b73dd735d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10b4e386455efe51265b0a3d67747928b36c92bc2e83e5929522cb0c22e481c1814428bb036c89a67c405cd8f2371718e061463051d2ec0f790f16f96f03c469', 'id': 'acb371fe-850e-4c61-92a3-074dbfacc8b9', 'created_at': datetime.datetime(2026, 6, 25, 22, 43, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 22, 43, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acb371fe-850e-4c61-92a3-074dbfacc8b9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e2459d2b140>}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f174ce9-b883-4cdb-8263-694097d06c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Volume volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c (824c63b1-62eb-49b2-a35b-84e22e3ab06c): created successfully
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f174ce9-b883-4cdb-8263-694097d06c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Flow 'volume_create_manager' (c23f2f00-d05a-4add-a03c-4d6881cde81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:00 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-c66633f3-924e-41b2-8339-c45568b04113 tempest-VolumeImageDependencyTests-814163601 None] Created volume successfully.
Jun 26 00:44:00 devstack sudo[115967]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c" returned: 0 in 0.715s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.467s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2082354549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96baf245-0bed-45b7-af81-5e8934567ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:54Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating volume 96baf245-0bed-45b7-af81-5e8934567ddb {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:44:00 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:00 devstack sudo[115973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb 1073741824
Jun 26 00:44:00 devstack sudo[115973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28946405-8e5b-4bae-9662-441a56dd6398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8234d1-ace4-4422-81c4-15d0dae068cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:00 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c (36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c): created successfully
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8234d1-ace4-4422-81c4-15d0dae068cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:00 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (21c6cd96-8c9d-4445-a1b6-d573b29dbaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:01 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-2ad2e89c-271a-4ef7-8238-79cf1511ba49 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created volume successfully.
Jun 26 00:44:01 devstack sudo[115975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:01 devstack sudo[115975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Acquiring lock "cinder-824c63b1-62eb-49b2-a35b-84e22e3ab06c-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:01 devstack sudo[115975]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.719s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Lock "cinder-824c63b1-62eb-49b2-a35b-84e22e3ab06c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Acquiring lock "cinder-quobyte-824c63b1-62eb-49b2-a35b-84e22e3ab06c" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Lock "cinder-quobyte-824c63b1-62eb-49b2-a35b-84e22e3ab06c" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08750f4-9ce1-47e6-b37d-d3a87ee12ed9]: (4, 'raw') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:01 devstack sudo[115973]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb 1073741824" returned: 0 in 1.014s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:02 devstack sudo[115983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:44:02 devstack sudo[115983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:02 devstack sudo[115984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb
Jun 26 00:44:02 devstack sudo[115984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:02 devstack sudo[115984]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb" returned: 0 in 0.671s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:02 devstack sudo[115983]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.839s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054298784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb016fe-c103-4232-93e0-241a6d647f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a539dbdee79c4daeb9609bf9378664b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:55Z,use_quota=True,user_id='7d56b5e0c45f468ca4609881508c0c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Creating volume 8fb016fe-c103-4232-93e0-241a6d647f1a {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:44:02 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 0 in 0.829s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:02 devstack sudo[115990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a 1073741824
Jun 26 00:44:02 devstack sudo[115990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b70b46-8d3f-4fc4-abf1-2a1028912a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96baf245-0bed-45b7-af81-5e8934567ddb', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bdafa3-9e12-418a-acf8-462f1bda6e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:02 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume volume-96baf245-0bed-45b7-af81-5e8934567ddb (96baf245-0bed-45b7-af81-5e8934567ddb): created successfully
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bdafa3-9e12-418a-acf8-462f1bda6e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:02 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (4488e918-c76d-4e87-88d1-ce08ea1fdca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:02 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0e543865-f3e0-4906-91bd-0d55b0c461a3 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created volume successfully.
Jun 26 00:44:02 devstack sudo[115992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:44:02 devstack sudo[115992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:03 devstack sudo[115992]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 1 in 0.827s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c' failed. Not Retrying. {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 00:44:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:03 devstack sudo[116007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c
Jun 26 00:44:03 devstack sudo[116007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:03 devstack sudo[115990]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a 1073741824" returned: 0 in 0.949s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:03 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:03 devstack sudo[116009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a
Jun 26 00:44:03 devstack sudo[116009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:04 devstack sudo[116007]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-824c63b1-62eb-49b2-a35b-84e22e3ab06c" returned: 0 in 0.694s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Lock "cinder-quobyte-824c63b1-62eb-49b2-a35b-84e22e3ab06c" released by "delete_volume" :: held 2.434s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Created reservations ['c8d72070-60d4-4c37-b55c-98c18084113c', 'e6bacc3a-43aa-4282-8276-18ec216a1931', '46b4ff38-db25-4883-8213-598027840e54', '9f3900fe-5d4e-40ca-b4df-359419e9ac65'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:04 devstack sudo[116009]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a" returned: 0 in 0.647s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.671s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1042453709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97421c7c-847c-4f8b-962a-b539bc8e056e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe3d5469e7f45a7bbe048913b2d4cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:43:58Z,use_quota=True,user_id='acd1e5fca19047d2a875fffd2bcb0d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Creating volume 97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:44:04 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e26b852-b866-4688-8bd8-fe79bec52ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb016fe-c103-4232-93e0-241a6d647f1a', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d5674a-93e3-44a2-a188-d30ecd8992d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:04 devstack sudo[116013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e 1073741824
Jun 26 00:44:04 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:04 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Volume volume-8fb016fe-c103-4232-93e0-241a6d647f1a (8fb016fe-c103-4232-93e0-241a6d647f1a): created successfully
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d5674a-93e3-44a2-a188-d30ecd8992d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Flow 'volume_create_manager' (2fd24514-043c-4817-bdda-8842f0c6c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:04 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-da778e5e-3d7c-4dfb-8cc4-9b8bf25e930f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created volume successfully.
Jun 26 00:44:04 devstack sudo[116015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:04 devstack sudo[116015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-8fb016fe-c103-4232-93e0-241a6d647f1a-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-8fb016fe-c103-4232-93e0-241a6d647f1a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-8fb016fe-c103-4232-93e0-241a6d647f1a" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-8fb016fe-c103-4232-93e0-241a6d647f1a" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[6366841e-fc2c-40fa-9f70-a2ef60e62a8f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:04 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:04 devstack sudo[116018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a
Jun 26 00:44:04 devstack sudo[116018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:05 devstack sudo[116015]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.756s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:05 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Deleted volume successfully.
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-a6d9c778-ed7c-4cdd-b67e-a03edeeb8ea6 tempest-VolumeImageDependencyTests-814163601 None] Lock "cinder-824c63b1-62eb-49b2-a35b-84e22e3ab06c-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:05 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e 1073741824" returned: 0 in 0.986s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:05 devstack sudo[116025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:05 devstack sudo[116025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:05 devstack sudo[116018]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a" returned: 0 in 0.855s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:05 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:05 devstack sudo[116030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a
Jun 26 00:44:05 devstack sudo[116030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:06 devstack sudo[116025]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 0.791s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e245ab3de20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:44:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2021982663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704d641e-5201-45e7-a1c0-96ba30e00320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae22e9430c04f0698a1741499499502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:44:01Z,use_quota=True,user_id='e13d8964792e4b4ea34b65044c957871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)}" {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Creating volume 704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:44:06 devstack cinder-volume[94563]: INFO cinder.volume.drivers.remotefs [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] casted to osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 1073741824 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:06 devstack sudo[116034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 1073741824
Jun 26 00:44:06 devstack sudo[116034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d58b4d8-f22c-4114-a75a-b770eef210a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97421c7c-847c-4f8b-962a-b539bc8e056e', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75361333-e9a1-492f-93a2-9391f0026403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:06 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Volume volume-97421c7c-847c-4f8b-962a-b539bc8e056e (97421c7c-847c-4f8b-962a-b539bc8e056e): created successfully
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75361333-e9a1-492f-93a2-9391f0026403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Flow 'volume_create_manager' (1ee9ad9e-6e9d-48e2-a0d6-26c6381e48e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:06 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-31a4c63a-8c7f-49e3-a523-c5e447ef0b64 tempest-SnapshotDependencyTests-873751220 None] Created volume successfully.
Jun 26 00:44:06 devstack sudo[116030]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8fb016fe-c103-4232-93e0-241a6d647f1a" returned: 0 in 0.747s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-8fb016fe-c103-4232-93e0-241a6d647f1a" released by "delete_volume" :: held 1.658s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['90a9f418-1148-451c-bcea-ec7cc4066854', '15c1a77e-8ce4-4d66-86ac-5ef6c4a0ca6c', 'e99c58a1-83c3-42b5-b622-a1c4138853f9', 'a5a4a6ca-4024-4f83-b5be-7256530e533e'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:06 devstack sudo[116036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:06 devstack sudo[116036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-96baf245-0bed-45b7-af81-5e8934567ddb-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:06 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-96baf245-0bed-45b7-af81-5e8934567ddb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-96baf245-0bed-45b7-af81-5e8934567ddb" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-96baf245-0bed-45b7-af81-5e8934567ddb" acquired by "delete_volume" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6eba96-b5d4-473a-8803-e35e502ff5f1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:07 devstack sudo[116041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb
Jun 26 00:44:07 devstack sudo[116041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:07 devstack sudo[116036]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.889s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:07 devstack sudo[116034]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 1073741824" returned: 0 in 1.168s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:07 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleted volume successfully.
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-7af89629-bb25-4e66-8fec-9fd96e98de73 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-8fb016fe-c103-4232-93e0-241a6d647f1a-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:07 devstack sudo[116046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320
Jun 26 00:44:07 devstack sudo[116046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:07 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:08 devstack sudo[116041]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb" returned: 0 in 0.947s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:08 devstack sudo[116051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb
Jun 26 00:44:08 devstack sudo[116051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:08 devstack sudo[116046]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320" returned: 0 in 0.761s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'} {{(pid=94563) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.644s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Creating offline snapshot cecc09e2-3770-4c04-a72d-966ed519310a of volume 97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7643b2-06bb-455a-8e41-daf971469dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704d641e-5201-45e7-a1c0-96ba30e00320', 'volume_size': 1}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4f17e2-9c16-4360-a88f-c0bed266359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c7359b-8c3e-463f-b5c0-9991d35954f6]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:08 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Volume volume-704d641e-5201-45e7-a1c0-96ba30e00320 (704d641e-5201-45e7-a1c0-96ba30e00320): created successfully
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4f17e2-9c16-4360-a88f-c0bed266359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Flow 'volume_create_manager' (1ad3c8ea-cd6a-48c0-8c89-71ff7f88cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:08 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-697c414d-221b-4690-a110-253d7dab9277 tempest-CinderUnicodeTest-1620531701 None] Created volume successfully.
Jun 26 00:44:08 devstack sudo[116054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:08 devstack sudo[116054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:08 devstack sudo[116051]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-96baf245-0bed-45b7-af81-5e8934567ddb" returned: 0 in 0.692s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-96baf245-0bed-45b7-af81-5e8934567ddb" released by "delete_volume" :: held 1.681s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['2d3e73b6-a363-4942-bbfc-672b7f8e4126', '59a09e17-924f-49ac-b909-74110906e92f', '36ac1c53-eef9-489b-9909-d4f5649ae46e', 'dcc94802-2f8f-49bc-a85b-77a1a3405635'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:08 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:08 devstack sudo[116057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:08 devstack sudo[116057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:09 devstack sudo[116054]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 0.808s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:09 devstack sudo[116062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a 1G
Jun 26 00:44:09 devstack sudo[116062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c" acquired by "delete_volume" :: waited 0.018s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[05511a8b-bab2-4f2f-a955-d6c11394c6d7]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:09 devstack sudo[116064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c
Jun 26 00:44:09 devstack sudo[116064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:09 devstack sudo[116057]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.759s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:09 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleted volume successfully.
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-dc110394-4382-4968-b095-ed90f2d8d86f tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-96baf245-0bed-45b7-af81-5e8934567ddb-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:09 devstack sudo[116062]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a 1G" returned: 0 in 0.903s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:09 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97421c7c-847c-4f8b-962a-b539bc8e056e -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:09 devstack sudo[116070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97421c7c-847c-4f8b-962a-b539bc8e056e -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a
Jun 26 00:44:09 devstack sudo[116070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:10 devstack sudo[116064]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c" returned: 0 in 0.845s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:10 devstack sudo[116075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c
Jun 26 00:44:10 devstack sudo[116075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:10 devstack sudo[116070]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97421c7c-847c-4f8b-962a-b539bc8e056e -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a" returned: 0 in 0.717s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:10 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a is being set with open permissions: ugo+rw
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:10 devstack sudo[116080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a
Jun 26 00:44:10 devstack sudo[116080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:10 devstack sudo[116075]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c" returned: 0 in 0.672s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c" released by "delete_volume" :: held 1.590s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['6b731d93-f805-4f00-8bbc-0cd0f6c7e4c2', 'e1d77250-8f0f-47cd-8c2b-e5a9b081d967', '978e88a4-d068-4e9f-a277-be530a21bc8e', 'db92c871-8eed-4b57-8af7-3bbdc0c4aece'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:10 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:11 devstack sudo[116083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:11 devstack sudo[116083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:11 devstack sudo[116080]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a" returned: 0 in 0.650s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:11 devstack sudo[116086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info
Jun 26 00:44:11 devstack sudo[116086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-d6a8abec-bda6-44a4-99d0-c497542ace07-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-d6a8abec-bda6-44a4-99d0-c497542ace07-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-d6a8abec-bda6-44a4-99d0-c497542ace07" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-d6a8abec-bda6-44a4-99d0-c497542ace07" acquired by "delete_volume" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4487a8d-5f75-4d5d-9c29-efa497048f0f]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:11 devstack sudo[116088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07
Jun 26 00:44:11 devstack sudo[116088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:11 devstack sudo[116083]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.702s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:11 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleted volume successfully.
Jun 26 00:44:11 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-8e25d07a-08dd-4993-9031-50ec922a413b tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-36d9c5e5-5ee2-440e-a1c2-d96f24b3ae9c-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:12 devstack sudo[116086]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info" returned: 0 in 0.679s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:12 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info is being set with open permissions: ugo+rw
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:12 devstack sudo[116092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info
Jun 26 00:44:12 devstack sudo[116092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:12 devstack sudo[116088]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07" returned: 0 in 0.759s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:12 devstack sudo[116097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07
Jun 26 00:44:12 devstack sudo[116097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:12 devstack sudo[116092]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.info" returned: 0 in 0.635s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.501s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.210s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Creating offline snapshot eb685673-58d9-474d-ad8d-14af5613b3e2 of volume 704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 00:44:12 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-279cb1a6-abda-49ae-9b84-8d4db0cd94e0 tempest-SnapshotDependencyTests-873751220 None] Create snapshot completed successfully
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6160084-6f90-437e-aa46-bf3c036bf75c]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:12 devstack sudo[116100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320
Jun 26 00:44:12 devstack sudo[116100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:12 devstack sudo[116097]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-d6a8abec-bda6-44a4-99d0-c497542ace07" returned: 0 in 0.640s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-d6a8abec-bda6-44a4-99d0-c497542ace07" released by "delete_volume" :: held 1.451s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:12 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['b5e70da7-65ba-44b9-8a92-b71a22bc0bc5', '5128ab01-54ce-4990-8504-42eb066a3d40', '7c1d2202-9f2b-4a9c-bee8-9b9f5a04b425', '15230caf-12c0-4db7-9162-be0ef1bb7ec2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:13 devstack sudo[116103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:13 devstack sudo[116103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:13 devstack sudo[116100]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320" returned: 0 in 0.768s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 1G {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:13 devstack sudo[116108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 1G
Jun 26 00:44:13 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-67f793a5-efb0-4e3a-b626-f64f02513941-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-67f793a5-efb0-4e3a-b626-f64f02513941-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-67f793a5-efb0-4e3a-b626-f64f02513941" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-67f793a5-efb0-4e3a-b626-f64f02513941" acquired by "delete_volume" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:13 devstack sudo[116103]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f335bcfc-2834-4968-bebe-610c0b20caad]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.734s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:13 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleted volume successfully.
Jun 26 00:44:13 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-4b7d423e-49d9-40df-877f-2d6569d634ee tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-d6a8abec-bda6-44a4-99d0-c497542ace07-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:13 devstack sudo[116111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941
Jun 26 00:44:13 devstack sudo[116111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:14 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 1G" returned: 0 in 0.965s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704d641e-5201-45e7-a1c0-96ba30e00320 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94563) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 00:44:14 devstack sudo[116117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704d641e-5201-45e7-a1c0-96ba30e00320 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2
Jun 26 00:44:14 devstack sudo[116117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Flow 'volume_create_manager' (25c383b1-ffda-433b-80e6-3772203d1bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7b79bb-653d-480a-b2c8-20290e6f996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7b79bb-653d-480a-b2c8-20290e6f996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-25T22:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bc53a3-b7ea-4373-a693-3bf0d44d4f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe3d5469e7f45a7bbe048913b2d4cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T22:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cecc09e2-3770-4c04-a72d-966ed519310a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T22:44:14Z,use_quota=True,user_id='acd1e5fca19047d2a875fffd2bcb0d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1707228d-860b-4ba2-979c-c1695fd6b2eb),volume_type_id=1707228d-860b-4ba2-979c-c1695fd6b2eb)' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb0f04d-c849-4c59-b3c6-0214f3f25e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb0f04d-c849-4c59-b3c6-0214f3f25e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98721c0c-569c-482a-85dc-0768741a7599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98721c0c-569c-482a-85dc-0768741a7599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46bc53a3-b7ea-4373-a693-3bf0d44d4f2c', 'volume_name': 'volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c', 'volume_size': 1, 'snapshot_id': 'cecc09e2-3770-4c04-a72d-966ed519310a'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1e661b-f36d-45a2-ae21-552e2e91502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1e661b-f36d-45a2-ae21-552e2e91502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e78c49e-8906-4452-aeb2-5a3bc52e371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:14 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Volume 46bc53a3-b7ea-4373-a693-3bf0d44d4f2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c', 'volume_size': 1, 'snapshot_id': 'cecc09e2-3770-4c04-a72d-966ed519310a'}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:14 devstack sudo[116111]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941" returned: 0 in 0.899s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:14 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:14 devstack sudo[116123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941
Jun 26 00:44:14 devstack sudo[116123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:15 devstack sudo[116117]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-704d641e-5201-45e7-a1c0-96ba30e00320 -F qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2" returned: 0 in 0.774s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:15 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 is being set with open permissions: ugo+rw
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:15 devstack sudo[116129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2
Jun 26 00:44:15 devstack sudo[116129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:15 devstack sudo[116123]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-67f793a5-efb0-4e3a-b626-f64f02513941" returned: 0 in 0.651s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-67f793a5-efb0-4e3a-b626-f64f02513941" released by "delete_volume" :: held 1.609s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['f492736f-0097-4177-9c28-6db00ce0d5a0', '6eca1050-e910-4e31-840f-815c9b06348c', '973a4df8-46fe-429e-b011-42601c94c0d8', '3ec11eed-e948-4bc8-a417-914e831cb79a'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:15 devstack sudo[116131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:15 devstack sudo[116131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-60e7c3f3-77af-4e78-a011-63cf3c949833-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:15 devstack sudo[116129]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-60e7c3f3-77af-4e78-a011-63cf3c949833-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-56db8dcd-6ba3-4109-960c-d06edeed69a1" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2" returned: 0 in 0.687s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-56db8dcd-6ba3-4109-960c-d06edeed69a1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-60e7c3f3-77af-4e78-a011-63cf3c949833" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-60e7c3f3-77af-4e78-a011-63cf3c949833" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:15 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleting offline snapshot 60e7c3f3-77af-4e78-a011-63cf3c949833 of volume 56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] snapshot_file for this snap is: volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2b9f3-e535-401e-b0af-b8e57b9ea9d4]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:16 devstack sudo[116134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info
Jun 26 00:44:16 devstack sudo[116134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:16 devstack sudo[116135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833
Jun 26 00:44:16 devstack sudo[116135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:16 devstack sudo[116131]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.697s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:16 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleted volume successfully.
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-19f4319a-04d8-493f-820f-f81eb3c2b365 tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-67f793a5-efb0-4e3a-b626-f64f02513941-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:16 devstack sudo[116134]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info" returned: 0 in 0.679s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:16 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info is being set with open permissions: ugo+rw
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:16 devstack sudo[116142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info
Jun 26 00:44:16 devstack sudo[116142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:16 devstack sudo[116135]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833" returned: 0 in 0.786s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56db8dcd-6ba3-4109-960c-d06edeed69a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e3cb15-d8af-4b83-be93-5bbf1a590340]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:16 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:16 devstack sudo[116145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1
Jun 26 00:44:16 devstack sudo[116145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:17 devstack sudo[116142]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.info" returned: 0 in 0.697s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.726s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.776s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-quobyte-cecc09e2-3770-4c04-a72d-966ed519310a-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" by "_create_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-cecc09e2-3770-4c04-a72d-966ed519310a-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Creating volume 46bc53a3-b7ea-4373-a693-3bf0d44d4f2c from snapshot cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Selected osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2 as target Quobyte volume. {{(pid=94563) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-quobyte-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" by "_copy_volume_from_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:17 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-048339a0-376d-4168-8360-a8ee939255ca tempest-CinderUnicodeTest-1620531701 None] Create snapshot completed successfully
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] snapshot: cecc09e2-3770-4c04-a72d-966ed519310a, volume: 46bc53a3-b7ea-4373-a693-3bf0d44d4f2c,  {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37bd05-550a-4247-ac3d-61cb1dd7c3ef]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:17 devstack sudo[116145]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1" returned: 0 in 0.770s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:17 devstack sudo[116151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a
Jun 26 00:44:17 devstack sudo[116151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:17 devstack sudo[116152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833
Jun 26 00:44:17 devstack sudo[116152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-eb685673-58d9-474d-ad8d-14af5613b3e2-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-eb685673-58d9-474d-ad8d-14af5613b3e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-quobyte-704d641e-5201-45e7-a1c0-96ba30e00320" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-704d641e-5201-45e7-a1c0-96ba30e00320" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-quobyte-eb685673-58d9-474d-ad8d-14af5613b3e2" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-eb685673-58d9-474d-ad8d-14af5613b3e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Deleting offline snapshot eb685673-58d9-474d-ad8d-14af5613b3e2 of volume 704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] snapshot_file for this snap is: volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3491040f-275e-4650-a1b3-0f0ddcb79345]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:17 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:18 devstack sudo[116155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2
Jun 26 00:44:18 devstack sudo[116155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:18 devstack sudo[116151]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a" returned: 0 in 0.791s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97421c7c-847c-4f8b-962a-b539bc8e056e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Creating direct copy from snapshot {{(pid=94563) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f823b1-fa7c-4d14-acbb-8547141491e1]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:18 devstack sudo[116152]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833" returned: 0 in 0.771s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:18 devstack sudo[116164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833
Jun 26 00:44:18 devstack sudo[116164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:18 devstack sudo[116163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:18 devstack sudo[116163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:18 devstack sudo[116155]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2" returned: 0 in 0.851s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-704d641e-5201-45e7-a1c0-96ba30e00320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b955c9f-c6ed-47c2-a782-b145853746fb]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:18 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:18 devstack sudo[116170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320
Jun 26 00:44:18 devstack sudo[116170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:19 devstack sudo[116164]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1.60e7c3f3-77af-4e78-a011-63cf3c949833" returned: 0 in 0.737s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:19 devstack sudo[116163]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 0.828s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG cinder.utils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Path /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c not found in is_blk_device check {{(pid=94563) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-60e7c3f3-77af-4e78-a011-63cf3c949833" released by "_delete_snapshot" :: held 3.212s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-56db8dcd-6ba3-4109-960c-d06edeed69a1" released by "delete_snapshot" :: held 3.240s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:19 devstack sudo[116176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c
Jun 26 00:44:19 devstack sudo[116176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['2a628723-9465-4e4d-8453-c39a682c984e', 'ee5cec5e-f5d2-4091-bbc0-dae02c60d4a4', 'e5e170bf-8852-4f88-a9ed-8689d04d9c7f', '25fe5ac6-1653-43fe-9415-d148e6c0cbea'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:19 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Delete snapshot completed successfully.
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-e1b21e98-2008-4e93-988c-1c0778c0f52d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-60e7c3f3-77af-4e78-a011-63cf3c949833-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:19 devstack sudo[116170]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320" returned: 0 in 0.794s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:19 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:19 devstack sudo[116181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2
Jun 26 00:44:19 devstack sudo[116181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-56db8dcd-6ba3-4109-960c-d06edeed69a1-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-56db8dcd-6ba3-4109-960c-d06edeed69a1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "cinder-quobyte-56db8dcd-6ba3-4109-960c-d06edeed69a1" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-56db8dcd-6ba3-4109-960c-d06edeed69a1" acquired by "delete_volume" :: waited 0.028s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[c565f492-0d8b-4e7e-b7a8-d0f0993b7852]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:20 devstack sudo[116197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1
Jun 26 00:44:20 devstack sudo[116197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:20 devstack sudo[116181]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2" returned: 0 in 1.273s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:20 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:20 devstack sudo[116199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2
Jun 26 00:44:20 devstack sudo[116199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:22 devstack sudo[116199]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320.eb685673-58d9-474d-ad8d-14af5613b3e2" returned: 0 in 1.413s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-eb685673-58d9-474d-ad8d-14af5613b3e2" released by "_delete_snapshot" :: held 4.479s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-704d641e-5201-45e7-a1c0-96ba30e00320" released by "delete_snapshot" :: held 4.520s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:22 devstack sudo[116197]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1" returned: 0 in 1.993s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:22 devstack sudo[116205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1
Jun 26 00:44:22 devstack sudo[116205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Created reservations ['ccb5166b-c96f-4e20-bf63-15afb336d1db', 'cbb47a32-f03f-4326-8320-44f75ea46733', '8dbd9c3d-c92f-4ae0-bc62-0a25794448e4', '1c72d6b1-b7ca-4fd5-a014-652f100bfeeb'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:22 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Delete snapshot completed successfully.
Jun 26 00:44:22 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-0d859cd7-a334-4039-a1a6-ca6516bb996a tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-eb685673-58d9-474d-ad8d-14af5613b3e2-delete_snapshot" released by "delete_snapshot" :: held 4.961s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-704d641e-5201-45e7-a1c0-96ba30e00320-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-704d641e-5201-45e7-a1c0-96ba30e00320-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-quobyte-704d641e-5201-45e7-a1c0-96ba30e00320" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:23 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-704d641e-5201-45e7-a1c0-96ba30e00320" acquired by "delete_volume" :: waited 0.025s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:23 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b891a-3ffe-463d-b831-648792c9c10e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:23 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:23 devstack sudo[116207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320
Jun 26 00:44:23 devstack sudo[116207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:24 devstack sudo[116205]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-56db8dcd-6ba3-4109-960c-d06edeed69a1" returned: 0 in 1.582s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-quobyte-56db8dcd-6ba3-4109-960c-d06edeed69a1" released by "delete_volume" :: held 3.702s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Created reservations ['9f2b87cd-992e-46aa-b168-6c5e3e2e1ecc', '7b35604f-3ebc-4ce7-b1ac-ba5a35a81a45', '8af78928-554a-4137-bcaa-a4d43888cc3c', 'b323b8f3-0081-48a9-a9fd-b7c36ef53bb2'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:24 devstack sudo[116210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:24 devstack sudo[116210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:24 devstack sudo[116176]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" returned: 0 in 5.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5bf0d7-f522-4965-9d04-bc054e971fda]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:24 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:25 devstack sudo[116213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:25 devstack sudo[116213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:25 devstack sudo[116207]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320" returned: 0 in 1.509s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320 {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:25 devstack sudo[116220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320
Jun 26 00:44:25 devstack sudo[116220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:25 devstack sudo[116210]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.828s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:25 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Deleted volume successfully.
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-65f6feb5-2d9b-4d6a-b710-8e7a4e0a222d tempest-CreateVolumesFromSnapshotTest-1810600058 None] Lock "cinder-56db8dcd-6ba3-4109-960c-d06edeed69a1-delete_volume" released by "delete_volume" :: held 5.077s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:25 devstack sudo[116220]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-704d641e-5201-45e7-a1c0-96ba30e00320" returned: 0 in 0.722s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-704d641e-5201-45e7-a1c0-96ba30e00320" released by "delete_volume" :: held 2.353s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:25 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Created reservations ['5055987d-6faf-42cf-8220-1eb95ea07bf4', 'b9c6a29e-5530-40e3-a00f-c7f536e56dde', '035cdef2-2a91-457f-a6d7-60055940f8e3', '5e54652c-a484-46f6-8b06-2deffb0d1646'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:26 devstack sudo[116213]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 1.123s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.image.image_utils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Image conversion details: src /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c {{(pid=94563) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 00:44:26 devstack cinder-volume[94563]: INFO cinder.image.image_utils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Converted 1024.00 MB image at 179.36 MB/s
Jun 26 00:44:26 devstack cinder-volume[94563]: WARNING cinder.volume.drivers.remotefs [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c is being set with open permissions: ugo+rw
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:26 devstack sudo[116228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c
Jun 26 00:44:26 devstack sudo[116228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:26 devstack sudo[116230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:26 devstack sudo[116230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:26 devstack sudo[116228]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" returned: 0 in 0.693s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" released by "_copy_volume_from_snapshot" :: held 9.259s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-cecc09e2-3770-4c04-a72d-966ed519310a-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" released by "_create_volume_from_snapshot" :: held 9.308s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.336s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e78c49e-8906-4452-aeb2-5a3bc52e371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c', 'volume_size': 1, 'snapshot_id': 'cecc09e2-3770-4c04-a72d-966ed519310a'}' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:26 devstack sudo[116230]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d8806e-7595-46b2-bb3f-9446cab97757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.712s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Deleted volume successfully.
Jun 26 00:44:26 devstack cinder-volume[94563]: INFO cinder.volume.flows.manager.create_volume [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Volume volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c (46bc53a3-b7ea-4373-a693-3bf0d44d4f2c): created successfully
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d8806e-7595-46b2-bb3f-9446cab97757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94563) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Flow 'volume_create_manager' (25c383b1-ffda-433b-80e6-3772203d1bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94563) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-b3a3011a-18e2-4ac9-80bf-947f1f6531e7 tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-704d641e-5201-45e7-a1c0-96ba30e00320-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-8295f928-a645-4858-87c7-2496e5c4d29b-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:26 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-ce05522c-2334-469c-8f43-945a4dcc9d4b tempest-SnapshotDependencyTests-873751220 None] Created volume successfully.
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-8295f928-a645-4858-87c7-2496e5c4d29b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "cinder-quobyte-8295f928-a645-4858-87c7-2496e5c4d29b" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-8295f928-a645-4858-87c7-2496e5c4d29b" acquired by "delete_volume" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaaad57-9794-465d-a845-1e8f06e2a65e]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:26 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:27 devstack sudo[116234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b
Jun 26 00:44:27 devstack sudo[116234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:27 devstack sudo[116234]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b" returned: 0 in 0.750s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-cecc09e2-3770-4c04-a72d-966ed519310a-delete_snapshot" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:27 devstack sudo[116239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b
Jun 26 00:44:27 devstack sudo[116239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-cecc09e2-3770-4c04-a72d-966ed519310a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-quobyte-97421c7c-847c-4f8b-962a-b539bc8e056e" by "delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-97421c7c-847c-4f8b-962a-b539bc8e056e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-quobyte-cecc09e2-3770-4c04-a72d-966ed519310a" by "_delete_snapshot" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-cecc09e2-3770-4c04-a72d-966ed519310a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Deleting offline snapshot cecc09e2-3770-4c04-a72d-966ed519310a of volume 97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] snapshot_file for this snap is: volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6352bb-d914-4205-ac69-4a6615d2abac]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:27 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:27 devstack sudo[116241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a
Jun 26 00:44:27 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:28 devstack sudo[116239]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-8295f928-a645-4858-87c7-2496e5c4d29b" returned: 0 in 0.628s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-quobyte-8295f928-a645-4858-87c7-2496e5c4d29b" released by "delete_volume" :: held 1.414s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Created reservations ['44bba4d3-c95d-40a0-81ec-b9354ef9c88f', '034f9650-bab7-4aad-901d-02b2deed7803', 'bdbc428f-e0e8-4052-bf91-f69f915fd324', '1974cbf2-a110-4912-9929-74ed37816627'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:28 devstack sudo[116247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:28 devstack sudo[116247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:28 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a" returned: 0 in 0.749s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.remotefs [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97421c7c-847c-4f8b-962a-b539bc8e056e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94563) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cf3359-2060-4823-ad14-b6e750edbe43]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:28 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:28 devstack sudo[116249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:28 devstack sudo[116249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:29 devstack sudo[116247]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.659s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:29 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:29 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Deleted volume successfully.
Jun 26 00:44:29 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-59101934-7ed4-412e-ada6-d981e627320e tempest-CinderUnicodeTest-1620531701 None] Lock "cinder-8295f928-a645-4858-87c7-2496e5c4d29b-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:29 devstack sudo[116249]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 0.790s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:29 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:29 devstack sudo[116255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a
Jun 26 00:44:29 devstack sudo[116255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:30 devstack sudo[116255]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a" returned: 0 in 0.738s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:30 devstack sudo[116260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a
Jun 26 00:44:30 devstack sudo[116260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:30 devstack sudo[116260]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e.cecc09e2-3770-4c04-a72d-966ed519310a" returned: 0 in 0.655s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-cecc09e2-3770-4c04-a72d-966ed519310a" released by "_delete_snapshot" :: held 3.022s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-97421c7c-847c-4f8b-962a-b539bc8e056e" released by "delete_snapshot" :: held 3.043s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Created reservations ['f7325d6b-8d16-4e47-a819-ec4554765d31', 'b27b2325-857b-4f17-85f0-79900ee77641', '98efb12b-dc85-4b4f-afcd-175734a9d339', '925222d2-8161-401b-889e-7b069e4bcca1'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:30 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Delete snapshot completed successfully.
Jun 26 00:44:30 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-58a7bc88-6741-42d2-b6ed-8d1e05b5fc6f tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-cecc09e2-3770-4c04-a72d-966ed519310a-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-97421c7c-847c-4f8b-962a-b539bc8e056e-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:31 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-97421c7c-847c-4f8b-962a-b539bc8e056e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-quobyte-97421c7c-847c-4f8b-962a-b539bc8e056e" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:32 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-97421c7c-847c-4f8b-962a-b539bc8e056e" acquired by "delete_volume" :: waited 0.016s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:32 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336e372-e90f-47bd-9051-d7043c46e4c3]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:32 devstack sudo[116263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:32 devstack sudo[116263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:32 devstack sudo[116263]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 0.739s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:32 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:32 devstack sudo[116268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e
Jun 26 00:44:32 devstack sudo[116268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:33 devstack sudo[116268]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-97421c7c-847c-4f8b-962a-b539bc8e056e" returned: 0 in 0.638s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-97421c7c-847c-4f8b-962a-b539bc8e056e" released by "delete_volume" :: held 1.440s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Created reservations ['a626b709-cbad-41c0-9232-3880d594b5ae', '59bdd61f-0eb7-4764-a3c9-4a766e110ccb', 'b4b16540-84e2-48e3-8db4-cbfffeb88624', '6083c468-a17f-48fd-bc55-bc7811859a4b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:33 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:33 devstack sudo[116271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:33 devstack sudo[116271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c-delete_volume" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:34 devstack sudo[116271]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.708s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:34 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Deleted volume successfully.
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "cinder-quobyte-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" by "delete_volume" {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-d40a524f-289f-4021-a502-83399b6ddf6b tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-97421c7c-847c-4f8b-962a-b539bc8e056e-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" acquired by "delete_volume" :: waited 0.017s {{(pid=94563) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce69ae-223d-4cb6-b142-34612fc08ff5]: (4, 'qcow2') {{(pid=95369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 00:44:34 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:34 devstack sudo[116274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c
Jun 26 00:44:34 devstack sudo[116274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:35 devstack sudo[116274]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" returned: 0 in 0.752s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:35 devstack sudo[116316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c
Jun 26 00:44:35 devstack sudo[116316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:35 devstack sudo[116316]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca/volume-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" returned: 0 in 0.630s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-quobyte-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c" released by "delete_volume" :: held 1.423s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG cinder.quota [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Created reservations ['e71992e1-49d0-490d-a364-4b5b57058714', '3270eee5-dec3-47e4-9726-20c2e59e4342', '16d2f9f2-81d8-404d-bd4b-b1a495a23aa1', 'd320423b-f7b9-4a57-b61f-7fba6800d84b'] {{(pid=94563) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:44:35 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:44:35 devstack sudo[116319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:44:35 devstack sudo[116319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:44:36 devstack sudo[116319]: pam_unix(sudo:session): session closed for user root
Jun 26 00:44:36 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.652s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:44:36 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:44:36 devstack cinder-volume[94563]: INFO cinder.volume.manager [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Deleted volume successfully.
Jun 26 00:44:36 devstack cinder-volume[94563]: DEBUG cinder.coordination [None req-de223726-a2fb-4d82-a4c9-ebe5425843f1 tempest-SnapshotDependencyTests-873751220 None] Lock "cinder-46bc53a3-b7ea-4373-a693-3bf0d44d4f2c-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=94563) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 00:44:45 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=97,cinder:UPDATE=134,cinder:DELETE=9,cinder:INSERT=40 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:44:46 devstack cinder-volume[94563]: DEBUG dbcounter [-] [94563] Writing DB stats cinder:SELECT=100,cinder:UPDATE=135,cinder:INSERT=34,cinder:DELETE=14 {{(pid=94563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2': None} {{(pid=94563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1eea5feb-5682-4e25-9835-bfb6dd60dad2'] {{(pid=94563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.lockutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94563) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 00:45:01 devstack sudo[116357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca
Jun 26 00:45:01 devstack sudo[116357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 00:45:01 devstack sudo[116357]: pam_unix(sudo:session): session closed for user root
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_concurrency.processutils [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01bc348de1786cf3e2ddb9d18db023ca" returned: 0 in 0.644s {{(pid=94563) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG cinder.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Notifying Schedulers of capabilities ... {{(pid=94563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG oslo_service.periodic_task [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] Running periodic task VolumeManager._thread_info {{(pid=94563) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread count: 28 {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 00:45:01 devstack cinder-volume[94563]: DEBUG cinder.volume.manager [None req-a3b4ecca-682d-4c5c-a0a3-f482e938c18e None None] thread info: [<_MainThread(MainThread, started 138694712479872)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138694605303488)>, <Thread(Thread-3 (stat_writer), started daemon 138694602210304)>, <Thread(Rabbit-heartbeat, started daemon 138694600968768)>, <Thread(Thread-5 (_runner), started daemon 138694601084544)>, <Thread(Thread-7 (_runner), started daemon 138694601103616)>, <Thread(fd_logger, started daemon 138694595715904)>, <Thread(privsep_reader, started daemon 138694595766144)>, <Thread(tpool_thread_0, started daemon 138694588061376)>, <Thread(tpool_thread_1, started daemon 138694579668672)>, <Thread(tpool_thread_2, started daemon 138694571275968)>, <Thread(tpool_thread_3, started daemon 138694562883264)>, <Thread(tpool_thread_4, started daemon 138694554490560)>, <Thread(tpool_thread_5, started daemon 138694546097856)>, <Thread(tpool_thread_6, started daemon 138694537705152)>, <Thread(tpool_thread_7, started daemon 138694529312448)>, <Thread(tpool_thread_8, started daemon 138694520919744)>, <Thread(tpool_thread_9, started daemon 138694512510656)>, <Thread(tpool_thread_10, started daemon 138694504101568)>, <Thread(tpool_thread_11, started daemon 138694495692480)>, <Thread(tpool_thread_12, started daemon 138694487283392)>, <Thread(tpool_thread_13, started daemon 138694478874304)>, <Thread(tpool_thread_14, started daemon 138694470465216)>, <Thread(tpool_thread_15, started daemon 138694462056128)>, <Thread(tpool_thread_16, started daemon 138694453647040)>, <Thread(tpool_thread_17, started daemon 138694445237952)>, <Thread(tpool_thread_18, started daemon 138694436828864)>, <Thread(tpool_thread_19, started daemon 138694428419776)>] {{(pid=94563) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}